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Factors in Length of Stay and Progress 
in Psychotherapy` 


Patrick L. Sullivan, 


Edward Glaser & Associates, San Francisco 


Christine Miller, 
VA Mental Hygiene Clinic, Oakland 


and William Smelser 
VA Hospital, Oakland 


Research in the area of prediction of out- 
come of psychotherapy has produced mainly 
contradictory findings and at the best only 
low degrees of predictive accuracy for any one 
variable. The reason probably lies in the fact 
that a wealth of factors may affect outcome 
in therapy. For the sake of convenience, these 
may be roughly classified into three groups: 
(a) characteristics of the patient; (b) char- 
acteristics of the therapist; (c) situational 
variables, such as clinic policies as to length 
of treatment, eligibility requirements, and 
external factors in the patient’s life. 

Because so many factors may be important 
in determining outcome of therapy in each 
one of these three groups, it seems unreason- 
able to expect more than a low degre of pre- 
dictability for any one factor which may be 
selected for study. Also, when one cross-vali- 
dates the findings of a previous investigator 
or changes the setting, factors of relevance to 
the outcome of therapy are almost certain 
to change in each of the three categories. 
Thus we find one investigator, Gallagher (5), 
who reported that high scores on Depression 
on the MMPI are associated with “success 
in psychotherapy, while Barron (2) fonnd 
that high Depression scores are associate 
with lack of improvement in psychotherapy. 
The possibilities for variation in factors of 
relevance to outcome of therapy are so nu- 
merous that the difficulties in generalizing 

1 Approved for publication by Veterans Adminis- 
tration Regional Office, San Francisco- 


from one setting to another seem almost in- 
surmountable. 

These thoughts have been generated from 
our experience in a study of factors related 
to length of stay and progress in treatment. 
After having several hypotheses confirmed in 
one sample, we undertook to cross-validate 
our findings with two other samples in the 
same setting. The inconsistency of most of 
our findings from one sample to another is of 
perhaps as much interest as a few of our find- 
ings which were consistent. 

The purposes of this study were threefold: 

1. We wished to evaluate the relationship 
of social status variables to length of stay and 
progress in psychotherapy in a VA mental 
hygiene clinic. Previous investigators (1, 8, 
9, 10) had found that high social status was 
associated with favorable outcome in therapy, 
and we wished to ascertain the extent to which 
this relationship would hold in our clinic. 

2. We wished to explore some of the psy- 
chological variables which might be associ- 
ated with social status in the hope of gaining 
a better understanding of what makes social 
status a predictor of outcome in psycho- 
therapy. Special scales from the MMPI were 
used in this endeavor, and these will be de- 
scribed below. We were also interested in any 
psychological differences between groups hav- 
ing favorable and unfavorable outcomes in 
therapy which would come to light on the 
MMPI. 
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3. We wished to examine available data on 
therapists in relation to length of stay and 
improvement. 

Method 


The data for the present study were gath- 
ered from the records of patients in the Vet- 
erans Administration Mental Hygiene Clinic, 
Oakland, California. Only the records of male, 
white veterans of either World War II or the 
Korean action were included. Data from pa- 
tients who terminated treatment by reason of 
legal ineligibility were not included. Our total 
sample consisted of 268 patients, of whom 
196 had completed the Minnesota Multiphasic 
Personality Inventory at the time of initial 
contact with the clinic. 

Data concerning the psychodiagnostic cate- 
gories of the patients are not presented. The 
diagnoses were examined by the investigators, 
and it was concluded that they were too un- 
reliable and too contaminated with legalistic 
procedures to provide a sound basis for group- 
ing. It may be noted, however, that only ap- 
proximately 25% of the patients were desig- 
nated as schizophrenic, so that our findings 
apply predominantly to psychoneurotic and 
psychosomatic cases. 

The study was begun by gathering the rec- 
ords of cases closed in 1952-53, which num- 
bered 131 (Group A). These data were ana- 
lyzed and the findings checked against a 
sample drawn in a similar manner from the 
1951 closings. It became apparent that an in- 
sufficient number of cases was available for 
the purpose (W is 43 for this second group, 
hereafter designated Group B), so an addi- 
tional sample was drawn from 1954-55 clos- 
ings. This last sample consisted of 94 cases 
and will be called Group C. 

The variables chosen for investigation may 
be divided into four groups as follows: 


A. Demographic measures: 

a. Age. 

b. Education. The number of years of schooling 
completed was translated into a seven-point scale in 
accordance with Warner’s Code (11). In this code 
high school graduates are coded three, college under- 
graduates two, and college graduates one. 

c. Occupation. Vocations were also transformed 
into scale scores following the above scheme, and 
again the relationship is an inverse one. 

d. Education plus Occupation. The scaled scores of 
the two single measures were added together to ap- 


è 


proach a more comprehensive measure of sociocco- 
nomic status. 

e. Education minus Occupation. The difference in 
coded values for Education and Occupation provided 
a measure of the discrepancy between education and 
vocation. 


B. Psychological test measures (N = 196): 
a. MMPI clinical and validating scales. 
b. Special MMPI scales: 

1. Social Status (developed by Gough [6] and 
found by him to be an accurate reflection of actual 
social status). 

2. Intellectual Efficiency (developed by Gough 
[7]. This was used as our only available measure of 
intellectual functioning. Scores on this scale have 
been shown to be significantly related to high school 
and college grades). 

3. Ego Strength (derived by Barron [3] by se- 
lection of items which differentiated a group of pa- 
tients who improved in psychotherapy from those 
who did not improve). 

4. Factor A (a measure of anxiety and general 
maladjustment developed by Welsh [12]). 

5. Factor R (a measure of both the ability and 
the tendency to repress developed by Welsh [12]). 


C. Therapist measures: 


a. Sex. 

b. Professional discipline (psychiatrist, psycholo- 
gist, social worker). 

c. Experience. An assignment of the therapists was 
made to “Experienced” if there was at least one year 
of staff work; otherwise, they were designated “In- 
experienced.” 


D. Outcome measures: 

a. Length of stay. The number of individual ther- 
apy interviews was used. In the vast majority of 
cases, interviews were held weekly, and that fre- 
quency may be taken as the definition of intensity 
of treatment for this study. The cases were split at 
the median number of interviews and designated 
Stay and Not-stay. 

b. Improvement ratings. Ratings on a five-point 
scale were made by the individual therapists after 
termination. One point indicated “worse,” and the 
other four points ranged from “no change” (two) 
to “much improved” (five). Only the cases which 
were above the median number of interviews, ie. 
the Stay group, were included in the Improved and 
Not-improved data analysis. Patients who received 
the lowest three points on the rating scale were cate- 
gorized as “Unimproved” and the others as “Im- 
proved.” It may be noted that these ratings, depend- 
ing as they do wholly upon the judgment of the 
treating therapist, are of unknown reliability and 
validity. Generalizations from the results must be 
regarded as exploratory only. In a sense, they may 
be looked upon as a measure of therapists’ habits in 
rating improvement. The number of interviews, On 
the other hand, is a more objective measure. 
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Results 
Length of Stay 


Table 1 contains the results for the 131 
cases constituting Group A, divided into Stay 
and Not-stay subgroups by dichotomizing at 
nine interviews, the median. Many measures 
significantly differentiate the two subgroups, 
with Education emerging as the most effec- 
tive single variable. The results of both the 
demographic and psychological measures show 
that the patients who were better integrated 
and more successful in life pursuits were the 
ones who remained in treatment longer. The 
Stay group is higher on Education and Oc- 
cupation. The MMPI findings show the Stay- 
ers to be higher on JE, Social Status, Ego 
Strength, and on R and K. Both of the latter 
may be regarded as reflecting the ability to 
hold together defenses effectively. Pa, on the 
other hand, is higher in the Not-stay group, 
which, along with the A measure, indicates 
greater maladjustment in that group. In the 


main, a general kind of psychological health 
appeared to be associated with the higher so- 
cial status characteristics of the Stay group. 

In Group A, most of our expectations with 
regard to psychological differences on the 
MMPI between Stayers and Not-stayers were 
confirmed. In contrast with Group A, the 
findings on psychological variables in Groups 
B and C shift markedly and are not consist- 
ent with those of Group A. 

In Table 2 are given the means, CR’s and 
ts where significant, for Groups B and C. 
Nonsignificant differences are not shown. The 
median number of interviews for Group B 
was identical with that obtained for Group A, 
i.e., nine, but was only five for Group C. No 
cause for this drop has been discovered, for 
there were no changes in the clinic’s treat- 
ment policy nor any important alterations in 
the eligibility requirements. 

Since the inconsistencies between groups 
might have followed from their being dichoto- 


Table 1 


Mean Differences Between Group A Stay and Non-stay Subgroups 


Stay Non-stay 
Variable Mean SD Mean SD CR b 
Demographic : s gi m és 
Age 30.7 59 pa al a osi 
Educational rating (Ed) 2.92 1.4 ne on ae v 
Occupational rating (Occ) 4,33 1.4 ass Fi ai os 
Ed plus Occ 7.23 2.3 cme a 
Ed minus Occ —1.41 1.4 <1, y ) 
MMPI special scales 
Social status 20.1 4.1 aa ap oe F 
Ego strength 41.5 or aa Ly a y 
; moe, efliciency zt 2A oe a 
R 18.3 4.0 16.5 58 1.80 04 
a regular scales wo gi asi ag ” 
a 59.7 10.2 60.9 109 S 
K 52.4 10.3 48.1 8.9 2.56 01 
Hs 76.6 15.8 75.7 15.2 aE 
D 79.5 15.4 82.1 18.1 ae 
H: 72.7 8.9 73.0 13.0 ag 
Pa 67.0 11.5 66.4 14.1 Fe 
M; 62.8 14.1 60.4 16.0 D5 
A 567 10.6 67 135 2.35 02 
i 72.1 15:5 73.3 15.7 He 
68.2 16.1 69.5 17.1 ae 
a 55.0 9.2 54.0 12.0 ns 
a 
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Table 2 
Cross-Validation of Differences Between Stay and Non-stay Subgroups in Groups B and C 


Stay Non-stay 
Group and. ee —— 
Variable Mean SD Mean SD t $ 
Group B 
Education 2.85 .93 3.7 1.12 2.65 02 
Occupation 4.24 1.74 4.67 1.36 ns 
Ed plus Occ 7.08 2.62 8.38 1.90 1.81 10 
Ed minus Occ —1,39 1.18 —=.97 1.34 ns 
Pi 78.8 s 70.7 s 2.1 .05 
Sc 75.4 66.3 . 1.88 .10 
Group C 
Ego strength 36.8 10.3 41.0 6.2 2.40 .02 
Hs 79.3 18.8 71.3 11.5 2.57 .02 
D 85.2 15.8 76.4 18.3 2.56 .02 


* SDs not given because data, unfortunately, were discarded after t's had been computed. 


mized at different points, it was decided, 
therefore, to re-examine the data for Group C, 
making the division into subgroups not at five 
but nine interviews. The results of this revised 
alignment of cases are given in Table 3. The 
greatest changes that result from this shift 
are in the means of the demographic variables. 
These results are much more similar to those 
of Group A, but none of them reaches signifi- 
cance. Among the MMPI scales, only minor 
differences in means between the original and 
revised subgroups of Group C are effected. 
Because none of our samples was very 
large, the data for Groups A, B, and C were 
combined to give a larger N, using the re- 
vised assignment of cases for Group C. The 
results are shown in Table 4. There are no 


Table 3 


Differences Between Stay and Non-stay in Group C 
(Revised alignment) 


Stay Non-stay 

Demographic — 

Variables Mean SD Mean SD 
Age 33.3 8.06 34.1 7.68 
Educational 

rating 2.86 1.15 3.09 1.27 
Occupational 

rating 4.30 2.47 497 1.84 
Ed plus Occ 7.36 3.05 8.05 2.80 


Ed minus Occ -187 145 


—1.46 1.40 


Note.—All differences are nonsignificant. 


significant differences between the Stay and 
Not-stay groups on the MMPI scales; in fact, 
the profiles of the Stay and Not-stay group 
are strikingly similar. This finding was to be 
expected because of the few significant dif- 
ferences within the individual samples and the 
frequent reversals of direction. Differences in 
demographic measures, on the other hand, are 
all significant except Education minus Occu- 
pation, Education being the most differentiat- 
ing among them. 

While we confirmed the findings of other 
investigators that social status variables are 
relevant to length of stay, we failed to identify 
any psychological variables which consistently 
differentiate the Stayers from Not-stayers. 


Therapeutic Improvement 


It will be recalled that the analysis of data 
for factors related to progress in treatment 
was limited to those cases included in the 
Stay category. Also, the division into Im- 
proved and Unimproved was effected by sub- 
suming under the former those cases rated in 
the highest two of the five points on the rat- 
ing scale. 

The handling of the data paralleled that 
described for the length-of-stay material. Be- 
cause the Ns in groups A, B, and C taken 
separately are so small, only the combined 
data for an N of 98 for demographic vari- 
ables and 83 for the MMPI variables are pre- 
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sented. It should be noted, however, that com- 
pared with the frequent reversals from year to 
year for the Stay and Not-stay groups, there 
was much more consistency from sample to 
sample on the MMPI variables. Table 5 pre- 
sents the findings for the total group of 
Improved compared with Unimproved. In 
marked contrast to the finding that the Stay 
and Not-stay groups were almost identical in 
MMPI profiles, nearly all the clinical scales 
show significant differences between the Im- 
provers and Unimprovers. The Improvers have 
generally lower profiles than the Unimprovers, 
suggesting as Barron has said that those who 
improve in psychotherapy are less sick in the 
first place (2). 

Turning to the demographic variables, the 
means of the Improved patients are seen to 
have contributed disproportionately to the 
differences found between the Stay and Not- 
stay groups. That is, the Improved show the 
Stay tendencies to a greater degree than do 


the Unimproved. The mean of Education for 
the Stay group contained in Table 4 is 2.84, 
for example, while the Improved group mean 
in Table 5 is 2.67; the Improved are better 
educated than the Stayers as a whole. 

As the psychological findings indicated that 
the Improved were less disturbed at the out- 
set of therapy than the Unimproved, so do 
the findings on the demographic variables 
show that they also held better positions and 
were employed in capacities more closely in 
keeping with their higher educational achieve- 
ment. 

Turning to other findings not covered in 
the foregoing tables, it might first be noted 
that there is a highly significant difference 
between the means of the number of inter- 
views of the Improved and Unimproved. The 
means are 31.9 and 21.3, respectively, which, 
with standard deviations of 24.1 and 15.9, 
yield a CR of 2.5 (p < .01). In view of the 
manner in which our progress ratings were 


Table 4 
Total Group (A, B, and C), Differences Between Stay and Non-stay 
Stay Non-stay 
ee 
Variable Mean SD Mean SD CR $ 
Depnpatnbit ‘a 58 33.2 7.48 ad 205 
Educational rating (Ed) 254. 1.18 an ae 274 OL 
Occupational rating (Occ) 4.27 1.87 30 243 3.52 ‘001 
Ed plus Occ 7.20 2.69 We 1.48 © ns 
Ed minus Occ —1.43 1.35 ae i 
MMPI special scales 
Social status 20.0 ro ns 
Ego strength 39.0 38.4 ns 
Intellectual efficiency 39.0 20.6 H 
A 20.1 y 
R 18.1 11.0 ji 
i regular scales ars 47.7 ug 
: 6 13 60.8 oa 
K 51.2 oa oa 
a 763 74.1 nS 
A 820 80.5 wa 
H 73.8 73.0 ns 
a 67.5 ee es 
Mt 63.7 a ae 
w 58.9 ane i 
pe 73.9 72.2 ies 
71.6 4 i 
a 56.9 ae a 
a 
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Table 5 
Total Group (A, B, and C), Differences Between Improved and Unimproved Cases 


Improved Unimproved 
Variable Mean SD Mean SD CR p 
Demographic 
Age 31.0 5.8 31.5 6.4 ns 
Educational rating 2.67 1.31 2.97 1.36 ns 
Occupational rating 3.89 1.33 4.65 1.30 2.84 01 
Ed plus Occ 6.56 1.70 7.60 2.46 1.97 10 
Ed minus Occ —1.18 0.98 —1.68 4 2.57 .01 
MMPI special scales 
Social status 20.2 19.5 ns 
Ego strength 41.8 38.5 ns 
Intellectual efficiency 40.1 38.4 ns 
A 18.0 73 21.8 6.6 2.69 01 
R 18.2 17.9 ns 
MMPT regular scales 
L 49.0 46.8 ns 
g 57.0 8.4 64.8 7.5 4.82 .0001 
K 52.8 50.1 ns 
Hs 74.1 7.5 78.1 8.3 2.5 02 
D 77.2 11.5 85.7 12.2 3.54 .001 
Hy 70.4 5.1 76.4 5.4 5.65 .0001 
Pd 64.8 9.3 69.3 8.6 2.46 02 
Mf 63.3 63.9 ns 
Pa 56.7 60.6 ns 
Pi 70.4 10.7 76.9 11.8 2.84 01 
Se 67.4 11.4 75.3 13.6 3.11 001 
Ma 54.7 7A 58.6 7.1 2.70 01 


obtained—i.e., from the treating therapist 
only—the determination of whether this find- 
ing is a “therapist” or “patient” phenomenon 
can only be left to speculation. 

The usefulness of single measures for indi- 
vidual prediction was closely examined. None 
of them provide an adequate basis for such a 
purpose, although Education approached sig- 
nificance for length-of-stay predictions. If the 
large group of high school graduates is elimi- 
nated, the groups with less than high school 
versus those with more, yield highly signifi- 
cant differences with regard to length of stay. 


Therapist Variables 


It was indicated earlier that measures of 
therapist variables were also studied. None of 
the results of this analysis of therapist vari- 
ables was significant. Therapists’ sex and pro- 
fessional training showed only chance rela- 
tionships with length-of-stay and progress 
ratings. Experienced therapists showed a sys- 


tematic but nonsignificant inclination to (a) 
keep patients in treatment longer and (b) 
rate marked improvement more frequently. 
It was also found, though again not con- 
sistently through the various samples, that 
more experienced therapists were assigned pa- 
tients with better prognosis, i.e., with higher 
educational and occupational standing. In or- 
der to learn whether the superior outcomes 
achieved by experienced therapists was a func- 
tion of experience or of better patient prog- 
nosis, the following analysis was made: Pa- 
tients were divided into High and Low Edu- 
cation groups. Chi squares were computed by 
comparing, first, Stay, Not-stay proportions 
between Experienced and Inexperienced thera- 
pists within the High Education group; then 
the same comparison was made for the Low 
Education group. A similar analysis was made 
for the Improved and Unimproved groupings. 
It was found that the Experienced Therapist- 
High Education combination showed a higher 
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probability for better outcome. The results 
were, however, far short of statistical signifi- 
cance. (p equals approximately .30 for both 
length-of-stay and progress.) The Low Edu- 
cation group had equally good or bad out- 
come regardless of therapist experience. 


Discussion 


The failure of the findings concerning length 
of stay of Group A to be substantiated in the 
other samples suggests several lines of thought. 
The most obvious implication to be drawn is 
that findings in this research area must be 
viewed with considerable tentativeness until 
thoroughly validated. This is particularly true 
of psychological test findings, as Windle has 
pointed out in his excellent review of the 
literature (13). 

We might also take cognizance of other 
ways in which this study fails to meet stand- 
ards of a comprehensive and rigorous investi- 
gation. The lack of objectivity in the thera- 
peutic outcome ratings has already been 
noted, as has the fact that adequate diag- 
noses were not available. The amount of diag- 
nostic homogeneity of our patient population 
can only be speculated on, and the differences 
in our measures among diagnostic categories 
is unknown. It has not been possible to de- 
scribe the variations in competence and ap- 
proach among therapists, nor is there infor- 
mation about such important items as date of 
onset of initial symptoms. Finally, our rat- 
ings do not encompass a follow-up period at 
all. 

Despite these limitations, our results corro- 
borate previous studies and add further sub- 
stantiation to a picture which is evolving with 
ever-increasing clarity. The core of this is that 
those persons who are least equipped to meet 
life challenges are the ones who stand to gain 
least from psychotherapy. N 

Aside from considerations of the situation 
and how it might be selectively contributing 
to the results, our findings highlight the dif- 
ference between “ability to use” and “need 
for” psychotherapy. These are not new con- 
cepts. They are obviously implicit 1n the cri- 
teria operating, for example, in the et Fs 
of patients for psychoanalysis during the tria 
analytic phase. In other treatment contexts, 
however, such as the one in which this study 


was conducted, the importance of the selec- 
tion of “good” patients is sometimes ob- 
scured. This has its commendable aspects, in 
that many patients who might be turned away 
from other treatment facilities are accepted 
and efforts made to rehabilitate them. It is 
the personal experience of the writers that 
such efforts expand considerably the horizons 
of the professional worker and force the evo- 
lution of thinking that might never be pro- 
duced were the selection of patients more 
rigorous. There are, furthermore, salutary ef- 
fects achieved in a minority of cases. The 
worth of maintaining persons on jobs, in their 
own homes, and preventing them from be- 
coming wards of hospitals cannot be gainsaid. 

The fact remains that these two concepts 
are inversely related in our population, and 
alleviation is not being effected in many of 
those cases where it is most pressingly needed. 
Quite contrary to the requirements and, im- 
plicity at least, the expectations of society, 
the patients most in “need” are being helped 
minimally if at all. 

If these persons are to be extended aid 
which may realistically be expected to be of 
benefit to them, it would appear that quite 
different approaches to their treatment will 
have to be evolved. In the development of 
these new attacks on the problem, the prin- 
cipal finding of this and other research (8, 9, 
10) provide adequate starting points. In par- 
ticular, if psychotherapy is characterizable as 
a process which places great importance on 
the ability of the patient to function at a high 
level of abstraction, the ability of the poten- 
tial patient to engage in this process will have 
to be more precisely determined. The finding 
with respect to Education supports the infer- 
ence that those with more schooling are both 
more intelligent and more capable of making 
abstractions about themselves. The research 
of Eells ef al. (4) into the relatively lower 
abstractional ability of lower socioeconomic 
groups is pertinent to ours and to the find- 
ings of the Yale group (9). An approach such 
as the foregoing would be aimed at identify- 
ing those patients who are capable of entering 
into treatment as it is presently conducted by 
the majority of professional persons. 

What are the implications of these findings 
for patients who do not demonstrate the abil- 
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ity to function at a high level of abstraction? 
The authors do not pretend to have compre- 
hensive answers to this question but can at 
least extend suggestions. For one thing, it 
would be advisable to structure treatment at 
the outset for these patients in such a way as 
to concretize it. Specific time limitations on 
the length of treatment could be discussed at 
the time of intake and definite problem areas 
would be mutually agreed on and adhered to. 
Periodic summing-up, focused on the problem 
areas initially delineated, might be introduced. 
The effort to rehabilitate would be steered by 
the therapist with minimal demands on self- 
awareness and would focus instead on more 
concrete alternatives to the patients’ current 
perceptions and behaviors. In short, therapy 
would be tailored to suit the individual’s func- 
tioning ability to deal with gradated levels of 
abstraction. 

Our study also illustrates the difficulties en- 
countered in this area of research. Cross-vali- 
dations in the same setting failed to confirm 
most of the original findings and pointed up 
the difficulties of generalizing results even 
from one year to the next. After considering 
our own difficulties in getting stable findings, 
we propose a few suggestions for further re- 
search in this area, most of which seem ob- 
vious, but which nevertheless have not often 
been adhered to, 

1. Cross-validation of findings is essential 
in this area of research, An unexpectedly large 
Proportion of the obtained “significant” dif- 
ferences may vanish on repetition with suc- 
cessive patient groups in the same setting. It 
seems wise, therefore, to regard findings until 
they have been cross-validated as only inter- 
esting, possibly chance findings which need 
to be further tested, 

2. Large samples seem imperative because 
of the impossibility of controlling or even 
specifying many of the innumerable factors 
which can affect outcome in therapy. 


3. As many as Possible of the conditions of 
the study—the characteristics of patients and 
therapists—should be specified to aid in the 
evaluation of findings, 

4. The study of groups which are homo- 
geneous with regard to factors related to 
prognosis will enable meaningful differences 


to come to light in the context in which they 
are relevant. 

5. It may be that we will come to a view- 
point prevalent in industrial psychology that 
local norms are necessary for sufficiently ac- 
-curate prediction. Preliminary work may help 
to delineate some broad factors of relevance 
to outcome in therapy. It may be that from 
there on our efforts will be best expended in 
developing norms for our particular settings, 
patient populations, and possibly therapists. 


Conclusion 


A study of the factors related to length of 
stay and progress in psychotherapy in a VA 
mental hygiene clinic was carried out. Par- 
ticular attention was given to measures of 
social status and to psychological variables 
which might be associated with social status. 
It was found that while the Stay and Not- 
stay groups did not show any distinguishable 
differences on the psychological variables used 
(MMPI), the demographic variables of Edu- 
cation and Occupational level did differentiate 
the Stayers from the Non-stayers. When pa- 
tients who were rated improved in psycho- 
therapy were compared with those rated un- 
improved, patients with higher occupational 
achievement and less psychopathology proved 
to be more successful in treatment. 
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Analysis of Self and Peer Personality Ratings of Psy- 
chotherapists and Comparison with Patient Ratings’ 


Eli A. Rubinstein 


Veterans Administration and Catholic University 


Studies attempting to compare factor pat- 
terns of normal and maladjusted persons de- 
rived from personality measurements on the 
same battery of tests have been relatively 
few. Among these studies the usual finding 
has been that the factor structure is similar 
even though the levels of scores differ. 

As part of a larger research on evaluation 
of change during psychotherapy, 100 psycho- 
therapists in ten VA mental hygiene clinics 
anonymously rated themselves on a multi- 
dimensional rating scale previously used with 
a patient sample. At the same time, 100 peers 
made ratings of these same therapists, with 
self raters sometimes acting as peer raters. 
These data lend themselves to further ex- 
amination of the relationship between factor 
patterns of normal individuals versus a pa- 
tient population. 

The major hypothesis tested was that the 
personality patterns of a nonpatient sample 
would not differ from personality patterns 
emerging from analysis of a patient sample. 
The analysis of the ratings was in terms of 
25 items representing six factors previously 
identified and confirmed with two successive 
samples of neuropsychiatric patients. Tetra- 
choric correlations of the 25 items with each 
other were computed for the 100 self ratings 
and the 100 peer ratings. The resulting two 
matrices were each independently clustered 
according to these previous factor patterns 


1 An extended report of this study may be ob- 
tained without charge from Eli A. Rubinstein, Neu- 
ropsychiatric Research Laboratory, Veterans Ad- 
ministration, Veterans Benefits Office, Munitions 
Building, Washington 25, D. C., or for a fee from 
the American Documentation Institute. Order Docu- 
ment No. 5432, remitting $1.25 for microfilm or 
$1.25 for photocopies. G 


and a multiple group method of factoring was 
employed. For the peer ratings of therapists, 
this a priori clustering did reveal linearly in- 
dependent groups. Rotation to simple struc- 
ture produced essentially the same six factor 
patterns as originally isolated with the pa- 
tient samples. For the self ratings of thera- 
pists, factoring of the a priori clusters broke 
down because of the linear dependence of 
one of the groups. 

As a result of this latter finding, the com- 
parable pairs of correlations in the two mat- 
rices of ratings were inspected. Evidence for 
greater generalization in peer ratings is to be 
found in the fact that only 35 self rating 
correlations are greater than .40, while 74 of 
the peer rating correlations exceed that value. 
Chi square for the two complete sets of cor- 
relations, split at a common median, is 9.63, 
p< 01. 

In further examination of the two matrices, 
20 pairs of correlations were found in which 
the significance of the difference between the 
pair was beyond the .01 level. In all but two 
cases the high correlation was in the matrix 
of peer ratings. In all but three of these 
twenty pairs of correlations, one or both of 
the scales are rated, for the peer ratings, 
mainly on inference. Apparently, there is less 
concomitance of certain manifest and covert 
behavior, as reflected by their self ratings, 
than would be presumed from peer ratings. 

The finding suggests that when comparisons 
of ratings on covert behavior are made be- 
tween self and other ratings, interpretation of 
similarities or differences should be made with 
considerable caution. 


Brief. Report. 


pReceived October 4, 1957. 
10-: - 


Journal of Consulting Psychology 
Vol. 22, No. 1, 1958 diii 


A Scale for Personality Rigidity *’ 
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This is a report of the construction, by em- 
pirical methodology, of a scale for personality 
rigidity. 

As part of an earlier project (6), a survey 
was made of a number of different types of 
personality studies in order to define the ma- 
jor elements and correlates of the rigidity- 
flexibility dimension. The types of behavior 
referred to by the dimension were found to 
be quite similar among all the studies, and 
the following summary of the qualities most 
commonly included at the rigid pole was 
made: (a) constriction and inhibition, (b) 
conservatism, (c) intolerance of disorder and 
ambiguity, (d) obsessional and perseverative 
tendencies, (e) social introversion, (f) anx- 
iety and guilt. 

This summary may be considered as a com- 
prehensive connotative definition of the term 
personality rigidity, established empirically 
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according to the criterion of common psy- 
chological usage. The synopsis, though more 
extensive, incorporates all the elements of 
Fisher's summary description of personality 
rigidity which is the following: “flexibility, 
fluidity, rigidity, perseveration and obsessive- 
compulsiveness . . . have all tended to refer 
to the idea that the behavior of people in 
different situations varies along a continuum 
marked at one extreme by cautious guarded- 
ness or limitation of reaction, and at the other 
extreme by freedom of reaction or lack of de- 
fensive caution” (2, p. 342). 

The degree to which the scale assesses the 
characteristics denoted by the above two syn- 
opses will be considered as an indication of 
its validity as a measure of personality ri- 
gidity. 

Procedure and Results 
Setting 


The raw data used in this study had been 
gathered previously in the course of a num- 
ber of assessment and field-testing programs 
carried on by the University of California’s 
Institute of Personality Assessment and Re- 
search (IPAR) (5). 


Subjects 


The assessed Ss whose responses were used 
in constructing the scale included the follow- 
ing: (a) 80 advanced graduate students (40 
in each assessed sample) from various de- 
partments in the University of California, 
(b) 80 senior medical students (40 in each 
assessed sample) from the University of Cali- 
fornia Medical School, (c) 70 candidates for 
admission to the University of California 


construed as necessarily crn the Se pial and (d) 100 Air Force cap- 
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Criterion Ratings 


As part of the assessment program, each 
assessee was rated by IPAR staff members, 
consisting of professional psychologists and 
graduate research assistants, on a number of 
variables, including that of rigidity. The mean 
rigidity rating for each S served as the cri- 
terion for scale derivation. 

The number of raters varied from sample to 
sample, but there were never fewer than five, 
and the average for all the groups was eight. 

The interrater reliability of the average rat- 
ing, computed by an analysis of variance tech- 
nique (1), ranged, across the samples, from 
.50 to .81, with an overall average of .73. 
Rigidity apparently exists as a sufficiently per- 
ceptible personality trait, so as to be rateable 
with significant interrater agreement. 


Item Selection 


The scale was compiled from a pool of 
957 “true”—“false” personality inventory items 
taken from the MMPI, the California Psy- 
chological Inventory (CPI) (4), and a num- 
ber of items especially constructed for the 
IPAR assessments, The construction of the 
scale involved item analyses in which the in- 
ventory results of the highest and lowest 25 
per cent on rated rigidity were compared and 
items chosen according to the significance 
level of the difference between the propor- 


tions of “true” responses among the highs 
and the lows, 


Cross-validation 


p ases employing other 
portions of the sample for obtaining the re- 


quired independent validity measures, The ob- 
tained measures were then considered as ap- 
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proximate estimates of the validity of the final 
scale which was derived from the total cri- 
terion sample. 

The first preliminary scale was based on the 
responses of the highest and lowest 25 per 
cent on rated rigidity from among the 80 
graduate students, the 80 medical students, 
and 40 of the 100 AF captains. A cross-valida- 
tion coefficient for the first scale, computed 
by correlating scale scores against ratings of 
rigidity for the 60 AF captains who had not 
been used in deriving the scale, came to .35 
(two-tailed test: $ < .01). This coefficient of 
-35 was considered as indicating that the first 
scale gives an adequate approximation of ri- 
gidity, and that this cross check confirmed the 
validity of the procedures utilized in its der- 
ivation. 

The second scale was a modification of the 
first as determined by the responses of the 
additional 60 AF captains. In the case of this 
second scale, a more extensive cross-validat- 
ing appraisal was obtained by correlating 
scale scores with a large number of traits, as 
indicated by ratings and Q sorts made by 
the IPAR staff. The 70 medical school ap- 
plicants, none of whom had been used in de- 
riving the second scale, were employed for 
this analysis. 

The scale was found to correlate positively 
with the following traits: (a) in interpersonal 
situations tends to be a listener or spectator 
54; (6) constriction .51; (c) tends toward 
over-control of his needs and impulses . . - 
delays gratification unnecessarily .44; (d) 
manifest anxiety 39; (e) has a readiness to 
feel guilty 36; (f) tends to delay or avoid 
decision .35; (g) does not vary roles; relates 
to everyone in the same way .33; (i) tends 
to ruminate and have obsessive thoughts .30; 
(i) is uncomfortable with uncertainties and 
complexities .30; (j) follows routine in liv- 
ing; is orderly 28; (k) rigidity .19, 

Negative correlations are with: (a) is self- 
indulgent — .51, (b) fluency of ideas — .45, 
(c) verbal fluency — .40, (d) impulsivity 
— 35, (e) originality — .35, 

A comparison of the above findings with 
the previously presented synopses of person- 
ality rigidity reveals an appropriate congru- 
ence between the correlates of the second scale 
and most of the elements contained in or de- 
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rivable from the synopses. The high scoring 
Ss tend to be rated as constricted, over-con- 
trolled, anxious, socially introverted, guilt 
prone, inflexible in their social roles, compul- 
sively doubtful, obsessive and ruminative, un- 
comfortable with uncertainties and complexi- 
ties, and orderly. Two of the highest corre- 
lates, constriction .51 and over-control .44, 
are, in psychological parlance, practically 
synonymous with the term “personality ri- 
gidity.” 

By contrast, low scoring Ss are likely to be 
judged as outgoing in social situations, fluent 
in thought and speech, impulsive, original, 
and self-indulgent. 

These characteristics of low scorers are 
clearly indicative of flexibility, the bipolar 
opposite of rigidity. 

The low correlation with the rating of ri- 
gidity could be due primarily either to error 
in the scale or to error in the ratings. Since, 
in the present instance, the scale shows sub- 
stantial and appropriate correlations with the 
key elements of the rigidity-flexibility di- 
mension, it seems reasonable to question the 
accuracy and/or comprehensiveness of these 
particular rigidity ratings. N 

The likelihood of considerable error in @ 
rating situation does not of course disqualify 
ratings as useful criteria in personality ye- 
search; but does indicate the desirability of 
ely large sample of ratings, as 


using a relativi ; 
was done in the present study, in order to 


balance out random error variance. 

Further cross-validating data on the second 
scale was obtained from an item analysis of 
the staff-checks on the Gough Adjective 
Check-List (3). As part of the assessment pro- 
gram, staff judges completed check-lists for 
each assessee. Composite staff descriptions 
were then derived by considering each adjec- 
tive which was selected for an S by three or 
more observers as being present, and all others 
as being absent. For the present analysis, 
adjective composites for the 18 highest and 
the 18 lowest scorers on the second rigidity 
scale from among the 70 medical school ap- 
plicants were compared. The following adjec- 
tives were found to differentiate significantly 


(.05 level) between high and low scorers. 


Adjectives more often chec 
anxious, conscientious, conserva 


ked about high scorers: 
tive, deliberate, de- 


pendent, gentle, inhibited, mild, moderate, modest, 
painstaking, peaceable, quiet, reserved, retiring, seri- 
ous, shy, sincere, submissive, thorough, timid, with- 
drawn, worrying. 

Adjectives more often checked about low scorers: 
active, adaptable, aggressive, argumentative, assertive, 
clear-thinking, confident, curious, demanding, ener- 
getic, independent, irritable, organized, outgoing out- 
spoken, planful, poised, quick, resourceful, self-cen- 
tered, self-confident, self-seeking, sociable, spontane- 
ous, talkative, versatile. 


The most salient dimension defined by the 
two sets of adjectives seems to be a bipolar 
factor characterized by an anxious restraint, 
and a meticulous conscientiousness, and con- 
servativism at one extreme; as contrasted 
with a vigorous, versatile, self-confident spon- 
taneity of thought and action at the other. 
These two contrasting categories are, in turn, 
very similar to the “cautious guardedness or 
limitation of reaction” vs. the “freedom of re- 
action or lack of defensive caution” which, as 
mentioned earlier, Fisher (2, p- 342) found 
to be the most essential characteristics of the 
rigidity-flesibility dimension. 

The final scale (to be known as Ri) was 
based on the inventory results of the highest 
and lowest 25 per cent on rated rigidity—83 
highs and 83 lows—from the total criterion 
sample.’ Ri is composed of 39 items, 20 sig- 
nificant at the .01 level, 18 significant at the 
05 level, and 1 significant at the .06 level. 


Scale Items 

The 39 Ri items, and the direction of the 
rigid response, are listed below. The items are 
grouped according to psychological categories, 
subjectively derived from an impressionistic 
content analysis made by the writer. 


Anxiety and constriction in social situations. 1. I 
usually don’t like to talk much unless I am with 
people I know very well, (T) 2. I like to talk before 
groups of people. (F) 3. It is hard for me to start a 
conversation with strangers. (T) 4. I would like to 
be an actor on the stage or in the movies. (F) 5. It 
is hard for me to act natural when I am with new 
people. (T) 6, I feel nervous if I have to meet a lot 
of people. (TD) 7 1 usually feel nervous and ill at 
ease at a formal dance or party. (T) 8. When I work 
on a committee I like to take charge of things. (F) 
es 


3 The number of Ss per item actually varied some- 
what from item to item, since not all the samples 
took identical, inventories. For the 39 Ri items, the 
N (“highs” plus “lows”) per item ranged from 106 
to 166, with a mean of 132. 
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9. I usually take an active part in the entertainment 
at parties. (F) 10. I am a better talker than listener. 
(F) 11. I try to remember good stories to pass them 
on to other people. (F) 12. I am embarrassed with 
people I do not know well. (T) 13. A strong person 
doesn’t show his emotions and feelings. (T) 

Need for a stable, orderly, predictable environment ; 
perseverative tendencies. 14. I must admit that it 
makes me angry when other people interfere with my 
daily activity. (T) 15. I find that a well-ordered 
mode of life with regular hours is congenial to my 
temperament. (T) 16. It bothers me when some- 
thing unexpected interrupts my daily routine. (T) 
17. I don’t like to undertake any project unless I 
have a pretty good idea as to how it will turn out. 
(T) 18. I find it hard to set aside a task that I have 
undertaken, even for a short time. (T) 19. I don't 
like things to be uncertain and unpredictable. (T) 

Slowness in coming to a decision—compulsive 
doubting. 20. I am very slow in making up my mind. 
(T) 21. At times I feel that I can make up my mind 
with unusually great ease. (F) 

Conservatism and conventionality. 22. I must admit 
I try to see what others think before I take a stand. 


(T) 23. I do not like to see women smoke, (T) 24, I 
would be uncomfortable i 


matter how brilliant or kind he might be. (T) 28, I 
would certainly 


game. (F) 29, I 
respondent for a newspaper. (F) 

Self-doubt and sensitivity to negative Criticism, 
30. I get very tense and anxious when I think other 
people are disapproving of me. 
tainly lacking in self- 
scolding makes me V 


spiders. (T) 


The items Suggest that the § rated high on 
rigidity differs, as indicated by self-report 
from the low-rated S$ in being socially and 
emotionally constricted; anxious; intolerant 
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Table 1 


Summary Statistics for the 39 Item Ri Scale and for 
27 Items of Ri Contained in the CPI 


39 27 
Item Scale Item Scale 
Sample N M SD M sD 
AF captains 343 16.01 5.01 10.65 4.32 
Medical school 
applicants 70 14.60 5.85 9.13 4.73 
Total 413 15.77 521 10.39 4.48 


of disorder, irregularity, and unpredictability ; 
perseverative; slow in making decisions; con- 
servative; conventional; lacking in self-con- 
fidence; misanthropic; and obsessionally in- 
volved in work. 

Since most of these qualities are indicative 
of rigidity, it may be concluded that, among 
the assessed Ss, self-descriptions tend to be 
consistent with the rigidity ratings. 


Reliability of the Scale 


The reliability of Ri was estimated by the 
split-half technique. In order to approximate 
equivalence of halves, an attempt was made 
to match items for the two halves according 
to similarity of content. The corrected reli- 
ability came to .72 in a sample of 60 field- 
tested AF captains. These Ss were not in- 
cluded among the 100 assessed AF captains 
used in deriving the scale. 


Summary Statistics 


Table 1 contains the mean and SD for Ri 
and for the 27 items of Ri which are con- 
tained in the CPI,* among a sample of 343 
AF captains and a sample of 70 medical 
school applicants. The mean and SD for the 
combined distributions are the most repre- 
sentative norms currently available. 

In conclusion, it should be noted that the 
present applicability of Ri is limited to men 


pie 

* The 27 CPI items, as numbered in the CPI book- 
let, and the direction of the rigid response are as 
follows: 13(T), 14(T), 16(T), 26(T), 38(T), 50(T), 
52(F), 58(T), 83(T), 85(T), 109(T), 150(T), 
159(T), 177(T), 219(T), 223(T), 239(F), 267(F), 
282(T), 284(T), 288(T), 296(F), 305(T), 328(T), 
418(T), 456(F), 471(F). 
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by the exclusively male composition of the 
samples used in scale construction. 


Summary 


A summary of the typical connotations of 
the personality rigidity concept was presented. 

By means of an item analysis technique, 
applied to 957 personality inventory items, a 
39-item scale for personality rigidity was de- 
rived. The criterion used for scale construc- 
tion was ratings of rigidity by staff assessors 
from the Institute of Personality Assessment 
and Research made on a total of 330 Ss. The 
highest and lowest 25 per cent on rated ri- 
gidity were used for the item analysis. 

Positive cross-validating evidence for two 
preliminary versions of the scale was pre- 


sented. 
Received April 11, 1957. 
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Validity of the Marsh-Hilliard-Liechti MMPI Sexual 
Deviation Scale in a State Prison Population’ 


John B. Wattron? 


Texas Prison System 


A scale derived from MMPI items for de- 
tecting sexual deviation tendencies has been 
reported by Marsh, Hilliard, and Liechti (1) 
which selected 88 per cent of sex deviants 
studied at the expense of 11 per cent false 
positives among UCLA students. Subse- 
quently, Peek and Storms (2) used this scale 
in a state hospital, comparing scores of sex 
offenders, mental patients, and psychiatric 
aids. They found the original cutting point of 
30 described by Marsh ef al., to be useless in 
discriminating between these groups. A new 
cutting score of 42 was more effective, yet 
neither point differentiated between sex of- 
fenders and mental patients. They concluded 
that the scale measured gross maladjustment, 
rather than sexual deviation tendencies, a pos- 
sibility that the original authors admit, 

In the present work, 60 sexual offender in- 
mates were matched with an equal number of 
other type felons on age, race, and sex. All 
were administered the full scale MMPI. Mean 


1An extended report of this study may be 
tained without charge from John B. Wattron, 
West 31 Bi; Austin, Texas, or for a fee from the 
American Documentation Institute. Order Document 


No. 5433, remitting $1.25 for microfilm, or $1.25 for 
photocopies, 


2 Now in residence, University of Texas. 


the MMPI scales were compared with their 
Sexual Deviation scale scores by correlation 
procedures. 

Mean scores for the felon group and the 
sex offender group were 46.9 (SD, 9.3) and 
49.2 (SD, 9.4) respectively, both of which 
exceed the mean score of 41.8 (SD, 9.1) re- 
ported for sex deviants by Marsh et al. Previ- 
ously determined cutting points were ineffec- 


tive in discriminating between the two groups 


of prisoners. The best cutting score, namely 
48, was inadequate in differentiating between 
groups according to the chi-square test. Cor- 
relations were obtained between Sexual Devia- 
tion scale scores and MMPI scales on inmate 
sex offenders as follows: Pt, .63, and D, .58 
(p = .001); Pd, .52, Sc, .51, and Ma, .49 
(p = 01); and F, .35 (p = .05). 

These results suggest that the Sexual De- 
viation scale is indeed a measure of gross mal- 
adjustment and that this instrument is of no 
practical value in discriminating between sex 
offenders and other type felons in correctional 
settings. 


Brief Report. 
Received September 20, 1957. 
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The Use of Multivariate Statistical Analysis of 
Minnesota Multiphasic Personality Inventory 
Scores in the Classification of Delinquent. 
and Nondelinquent High School Boys 


Peter P. Rempel* 


University Counseling Service, State University of Iowa 


The research worker in psychology and 
education is frequently confronted with the 
problem of analyzing differences between two 
or more groups of individuals with respect to 
several variables. The problem of differentiat- 
ing certain selected groups in terms of MMPI 
scores, for instance, is a good case in point. 
However, the kinds of statistical procedures 
commonly used may be subject to criticism 
on several grounds. Briefly, the several em- 
pirical methods of approach which have been 
developed lack the rigidity of a strictly math- 
ematical model, while such univariate proce- 
dures as the ¢ test or analysis of variance, 
when applied to separate keys of the MMPI, 
fail to take into account the amount of cor- 
relation that exists between scores on these 
keys. These procedures, in short, have failed 
to provide methods for obtaining mathemati- 
cally rigid statements of profile or pattern 
differences. 

It is one of the purposes of this paper to 
Provide an illustration of the application of 
More recently developed statistical proce- 

lures, namely the generalized distance func- 
tion (D?) and Fisher's discriminant function 
(LDF ) to the solution of problems involving 
the comparison of MMPI profiles. These tech- 
niques have been employed to find answers to 
the following questions: 3 

1. To what extent can groups of ondel 
quent and delinquent-prone ninth-grade ny 
Schoo] boys be differentiated in terms 0 
„t Submitted to the graduate school of the Univer 
i. = Minnesota in partial fulfillment of the require- 

“nts for the Ph.D. degree. 


MMPI profiles alone or in combination with 
school record information? 

2. To what extent can ninth-grade boys be 
classified correctly as either nondelinquents or 
potential delinquents in terms of MMPI pro- 
files alone or in combination with school rec- 
ord information? 


Basic Population 


The basic population of this study consists 
of ninth-grade boys enrolled in the public 
high school system of the city of Minneapolis 
for the school year 1947-1948, and to whom 
the MMPI was administered by Hathaway 
and Monachesi (4) in the spring of 1948. Of 
the 2,521 boys enrolled, 1,997 completed the 
test. Invalid test profiles with L scores of 10 
or over and/or F scores of 15 or over and 
omissions for various other reasons reduced 
the number of valid boys’ profiles to 1,802. 

In January, 1950, the median age of these 
youngsters tested was 17 years. A check made 
of the records of the Hennepin County Proba- 
tion Office and the Juvenile Division of the 
Minneapolis Police Department revealed that 
of those 1,802 boys 376 had appeared before 
the court, the police, or both. A second follow- 
up in 1952 raised the number of delinquent 
boys with valid profiles to 714. These profiles 
were distributed, in terms of severity of mis- 
conduct and number of delinquent acts com- 
mitted, among eight levels of delinquency as 
shown in Table 1. A preliminary study failed 
to reveal any statistically significant differ- 
ences between a randomly selected set of non- 
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Table 1 


Distribution of Valid MMPI Profiles by Delinquents, 
Level of Delinquency, and Nondelinquents 


PerCent Per Cent 
(Based on (Based on 
Classification Number N= 1802) N=714) 
All Delinquents 714 39.62 
Levels 1 and 2 363 20.15 50.84 
Level 3 231 12.82 32.35 
Level 4 47 2.61 6.58 
Level 5 31 1.72 4.34 
Level 6 22 1.22 3.08 
Level 7 12 0.67 1.68 
Level 8 8 0.44 1.12 
Total Level 3-8 351 19.47 49.16 
Nondelinquents 1,088 60.37 _ 
Total (all delinquents 
and nondelinquents) 1,802 100.00 = 


distributed among Levels 3-8, 
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In the major section of this study, referred 
to as the main study, this set of 351 delin- 
quent profiles was divided by random sam- 
pling procedures into two groups: Group A 
(NV = 175) which was used in the develop- 
ment of the classification formula, and Group 
B (N=176) set aside for cross-validation 
purposes. Two samples of 175 profiles each 
were similarly selected from the nondelinquent 
set of valid profiles. No statistically significant 
differences, in terms of level of delinquency 
and educational status achieved by 1952, were 
found to exist between delinquent samples A 
and B. The nondelinquent samples were found 
to be equal in terms of the latter criterion. 
The number of nondelinquents from a particu- 
lar school included in samples A or B was 
made to match the number of delinquents 
from that school. 

An analysis of three variables; namely, 
family status, mobility rating, and ratings of 
rent level, by means of chi-square techniques, 
failed to discriminate between delinquent and 
nondelinquent samples at statistically signifi- 


Table 2 


Comparison of Sample A 


Means and Variances for MMPI Scores of Nondelinquent 


and Delinquent Groups 


Total Delinquents 


Stratified Sample of 


Nondelinquents Tests of 
MMPI (N = 175) (N = 175) P Significance 
Scales Mean Variance Mean Variance t i 
a 

L 3.90 4.81 3.81 5.77 12 1.20 
K 13.76 15.91 13.49 17.26 .21 1.08 
f 6.90 13.30 5.40 10.53 4.06** 1.26 
Hs 52.86 67.98 50.59 86.30 2.42* 1.27 
D 52.28 96.19 51.64 96.17 61 1.00 
Hy 52.12 55.51 51.33 71.77 93 1,29 
Pd 64.18 88.45 57.51 110.94 6.234% 1.25 
Mf 50.08 62.37 53.58 83.07 3.8304 1.33 
pia 53.52 78.40 50.68 72.72 3.05** 1.08 
2 57.47 97.11 54.99 85.07 2.43* 1.14 
u 62.02 119.56 57.05 88.68 4.54** 1.35 
a 61.17 114.14 56.95 101.14 3.0704 1.13 
Sie 56.66 66.83 53.85 63.18 1.38 1.16 


Note.—Similar tests of si 


yielded significa: 
variance e: 


imant differences for the same eight scales. 
Stimates has been noted by asterisks: 


—SS a ee, 
— =a, © 


p” 
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Table 3 


Comparison of Sample 


A’ Means and Variances for the Variables of the Delinquent and 
Nondelinquent Groups in the School Study 


Nondelinquents Delinquents Tests of 
(¥ = 91) {y = 91) Significance” 
Variables Mean Variance Mean Variance t F 
L 3.7912 4.38 3.8022 6.23 -03 1.42 
K 13.6813 21.06 13.7373 19.66 08 1.07 
F 5.8462 14.72 7.1758 10.91 2.49* 1.35 
Hs 51.5055 60.29 53.3956 72.96 1.55 1.21 
D 51.6203 90.94 52.4514 96.50 .06 1.06 
ily 51.6483 49.50 52.0771 54.07 -40 1.09 
Pd 57.7912 94.89 64.9011 114.10 4.67** 1.20 
ay 51.9340 Sill 49,0440 80.71 2.16" 1.01 
Pa 88.38 54.3297 80.43 1.53 1.10 
PI 906.92 57.6593 67.01 1.71 1.45* 
Se 141.17 62.7912 73.18 ET: aii 1,93** 
Ma 141.72 61.4835 137.01 8:26" 1.19 
ee ai 53.05 52.71 .50 1.35 
Si 52.1538 53.0549 52.1 
Days Abi 7.0549 12.8791 32.76 4.96% A 
l 103.4900 99.6800 130.41 e pee 
2.1087 1.7171 5574 457 173 


y asterisks: 


a The level of significance is indicated b: 
* 05 level of significance; 
** 01 level of significance. 


cant levels, ‘To the extent that these three fac- 
tors tend to reflect the socioeconomic status 
of the student population under discussion, 
delinquents and nondelinquents may be re- 
garded as coming from essentially the same 
background. i 

A comparison of the means and variances 
for the MMPI scores of delinquents and non- 
delinquents is presented by means of Table 2. 
Choice of MMPI variables for inclusion 1m 
the classification formula was made on the 
asis of their potential contribution to the 
Seneralized distance function, D°. One statis- 
tic which provides a measure of this contribu- 
tion is the ratio of the square of the mean 
aa difference to an estimate of e 
ee of the distribution for each varia aie x 
T to as d?/S?, another ihe eres 
tion oo between variables. The ER 
sib] variables resulting in the W i 

>€ Separation of the two groups 1™ terms : 
pg “te the scores on the F, Hs; Sc, Mf, an 


s : 
Cales, arranged in that order- 


The School Study 


A second part of the study, referred to as 
the school study, dealt with the problem of 
identifying juvenile delinquents on the basis 
ofa combination of MMPI scores and school 
record data. The same basis population was 
used in both studies. However, the group 
from which experimental samples were chosen 
in the school study consisted of a total of 869 
boys used by Roessel (12) in his study of 
high school dropouts. Of these, 412 had left 
high school without graduating, while the rest 
(N = 457) constituted a random sample of 
those who had graduated. Of these 869 boys, 
182 proved to be delinquents - with valid 
MMPI profiles. From the remaining 687 pro- 
files, a control group of 182 nondelinquent 
profiles was chosen. As in the main study, 
poth delinquent and nondelinquent groups 
were divided into Samples A’ and BY Chi- 
square tests revealed no statistically signifi- 
cant differences in terms of delinquency level 
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and educational status between the delinquent 
samples of the school and the main studies, 
nor between the nondelinquent samples of the 
two studies in terms of the latter criterion. 
Comparisons of mean scores and variance es- 
timates for Sample A’ are reported by means 
of Table 3. Variables selected in terms of 
maximum contributions to D? were scores on 
the Ma, Sc, Mf, and Pd scales of the MMPI, 
honor point ratio, and number of days ab- 
sent, in that order. 


Discussion of Techniques Employed 


Rao (9) has shown that the degree of over- 
lap between any two clusters of points in a 
multidimensional space is measured by the 
generalized distance function, D*. The greater 
the numerical value of D?, the smaller the 
amount of overlap, so that this measure may 
be regarded as the “distance” between groups. 

To eliminate intervariable correlations Rao 
(11) suggested a method of transforming the 
original set of variables to an orthogonal set. 
Collier (3) Presented illustrations of the uses 
of Rao’s pivotal condensation techniques to 
effect the transformation in the Process of 
computing D?, Methods for testing the sig- 
nificance of D? have also been developed by 
Rao (8, 9, 10). 
The application of Fisher’s discriminant 


function to the problem of classification into 


Peter P. 


Rempel 


one or two known multivariate normal popu- 
lations was discussed by Anderson (1). Tests 
of the effectiveness of the LDF in classifying 
individuals correctly were presented by Lubin 
(7). For complete and comprehensive discus- 


sions of the techniques employed in this study — 


the reader is referred to Christensen (2), 
Lockman (6), and Johnson (5). 


Results 


In the main study, analysis of the data 
yielded a theoretical probability of correct 
classification for both delinquents and non- 
delinquents of 68.39 per cent. The overall 


percentage is essentially the same as that | 


achieved by chance when the ratio of non- 
delinquents to delinquents in the population 
is known to be 80.5 to 19.5 per cent, as it is 
in this study. However, classification of de- 
linquents by the LDF is more than three 
times as effective as chance procedures, the 
formula identifying 68.4 per cent of the de- 


linquents as against 19.5 per cent identified 
by chance. 


Empirical Cross Validation of Samples 
A and B 


The actual effectiveness of the linear dis- 
criminant function was tested empirically by 
applying the formulas developed on Sample A 
to the delinquent and nondelinquent sub- 


Table 4 


A Summary Comparison of 
for Samples A 


Classification Efficiency 
and B in the Main Study by Delinquent and N 
Groups within the Sample 


for the LDF Procedure with Chance Expectation 


ondelinquent 


Correct 


Correct 
Classification Classification 
by Formula by Chance Percentage t 
z a n nen 
Samples Used N % N % ‘ome Chance* 
Sample A (Dels.) (N = 175) 120 68 
6 
Sample A (Nondel.) (1V = 175) 115 657 ar ET eae 
Total Sample A (N = 350) 235 671 175.0 ny rate 
Sample B (Dels,) (N = 176) 124 7 , | 
Sample B (Nondel.) (V = 175) 103 ge gs 2 ry 
Total Sample B (WW = 351) 227 64.7 175.5 500 147 
All Groups (N = 701) 462 65.9 350.5 50.0 15.9** 


* Level of significance is indicated k: 
* 05 level of significance; By Meansiòf Sateriska: 
** 01 level of significance, 
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Table 5 


Classification of Delinquents by Level of Deli i 
its by Level o elinquency Using LDF Procedures for Two Rand 
Samples of the Main Study: Sample A on Which Prediction Formulae Were Se ees a 
Sample B on Which the Formulae Were Applied Through Cross Validation 


Percentage of Correct Classification 


Sample A Sample B Total 
(N = 175) (N = 176) (N E 351) 
Level? Total N % NV % N % 
3 231 82 70.7 78 67.8 160 69.3 
4 47 14 60.9 18 750 3268.1 
5 31 7 46.7 12 75.0 19 61,3 
6 22 9 81.8 8 73.0 17 77.3 
‘ 12 4 66.7 5 83.3 9 75.0 
8 8 4 100.0 3 75.0 7 87.5 
Total 351 120 68.6 124 70.5 244 695 


a In addition to the 351 delinquents in Levels 3 to 


8 above which had been randomly assigned to Samples A and B, 363 pupils 
Application of the same procedures identified 75 or 42.3% of the Level 1 


had been classified as delinquents of Levels 1 and 2. C ri 2 
f the Level 2 group, an overall correct classification of 51.2%, approximately the same as 


group as delinquent and 111 or 60.0% ol 

chance expectation, 

samples in both Samples A and B. A study of 
cross-validation results as presented in Table 4 
indicates that the overall percentage of correct 
classifications, namely 65.9 per cent, fell some- 
what short of the predicted percentage of 68.4. 
The fact that the formula correctly identified 
only 58.9 per cent of the nondelinquents in 
Sample B accounts for most of the shrinkage. 
However, 68.6 per cent of delinquents in Sam- 
ple A, and 70.5 per cent in Sample B were 


correctly identified. 


Classification results were also broken down 
in terms of delinquency level, as presented in 
Table 5. The tabulation shows generally in- 
creasing proportions of correct classification 
with level of delinquency, Level 5 being the 


only exception. 
Results of the School Study 


The probability of correct classification for 
both delinquents and nondelinquents was 
found to be 70.9 per cent. 


Table 6 


A Summary Comparison of Clas: 
for Samples A’ 


sification Efficiency for the LDF Procedures with Chance Expectations 
and B’ in the School Study by Delinquent and Non- 
delinquent Groups within the Sample 


Correct Correct 
Classification Classification 
by Formula by Chance Percentage 
—— Improvement 
Samples Used N % N % over Chance 
5 5.5 50.0 15.9** 
Sample A’ (Dels.) (N = 91) are S io aoe 
Sample A’ (Nondels.) (WV = 91) be 725 O10 500 rs 
Total Sample A’ (V = 182) 1 É 
45.5 50.0 19.2** 
Sample B’ (Dels.) (N = 91) o po 45.5 50.0 19.2** 
Sample B’ (Nondels.) (N = 91) 126 69.2 91.0 50.0 19.2** 
Total Sample B’ (N = 182) 
258 709 182.0 50.0 20.9** 
Total Samples A’ and B’ 


(N = 364) 


terisks 
* The level of significance is indicated by means of aster sh 


Bee 


ony asterisks indicate significance at the .01 level. 
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Table 7 


i i 4 i Jsi F fi { les of the School 
i of Delinquents by Level of Delinquency Using LDF Procedures for Two Samp f 
Gan Sake A’ on Which Prediction Formulas Were Developed and Sample B 
on Which the Formulas Were Applied Through Cross Validation 


Sample A’ Sample B’ Total 
(N = 91) (N = 91) (N = 182) 
Level N N % N % N % 
3 106 38 71.70 af 59.62 69 65.71 
4 30 9 60.00 12 75.00 21 67.74 
S 21 9 75.00 6 66.67 15 71.43 
6 13 5 71.43 5 83.33 10 76.97 
7 7 it 50.00 3 60.00 4 57.14 
8 5 1 50.00 3 100.00 4 80.00 
Total 182 6 09.23 600 65.93 123 67.58 


Results of cross-validation procedures (see 
Table 6) indicate that classification by the 
LDF permitted the correct identification of 
65.9 per cent of the delinquents in Sample A’ 
and of 69.2 per cent in Sample B’. Corre- 
sponding figures for nondelinquents are 79.1 
per cent and 69.2 per cent for Samples A’ and 
B’ respectively. In each case improvement 
over chance is significant at the .O1 level. 

Although the two studies are not strictly 
comparable, the addition of school record data 
raised the overall predictive efficiency of the 
LDF from 65.9 per cent in the main study to 
70.9 per cent in the school study, a difference 
significant at the .05 level. 

Classification results in terms of the level 
of delinquency are presented by means of 
Table 7. Again, an increase in the proportion 
of correct classifications corresponds closely 
with increase in level of delinquency, a 
marked drop in predictive efficiency at Level 
7 being the only exception in the general 
trend. 


Discussion 


Unlike a number of empirical methods 
which have been Suggested for the comparison 
of multiphasic Profiles, the evidence presented 
here suggests that multivariate statistical 
techniques provide a rigid measure of the dis- 
tance between two groups in terms of all the 
available numerical information. Unlike the 
measures achieved as a result of the applica- 
tion of univariate procedures to separate scales 
individually, the generalized distance function 


provides a single unit of measurement which 
is communicable, and lends itself particularly 
to the purpose of making comparisons from 
one study to another. Unlike univariate proce- 
dures, multivariate techniques may be used for 
the purposes of classification and prediction. 

The relatively high percentage of correct 
classifications achieved in this study, in spite 
of the well-known high degree of intercorrela- 
tion of MMPI variables ? and the numerically 
small average group differences on individual 
variables, may serve as an indication of the 
even greater usefulness of these techniques in 
research studies where these limiting factors 
do not exist to the extent they were found in 
the present investigation. 


Summary 


This study has demonstrated the usefulness 
of applying multivariate statistical techniques 
to the analysis of MMPI scale scores alone, 
or in combination with school data, for the 
purpose of classifying ninth-grade boys as 
potential delinquents or nondelinquents. The 
techniques employed proved to be effective to 
the extent that 62.3 per cent of the nondelin- 
quents and 69.5 per cent of the delinquents 
were correctly identified by the use of multi- 
phasic data alone; while a combination of 

2 Thus the median product-moment correlation co- 
efficients for the five variables of Sample A in the 
main study was .30, with a range of .06 to .49; cor- 
responding figures for the s; 


of the school study were: 
to 36. 


ix variables of Sample A’ 
median .04; range — 28 


ig 
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multiphasic and school record data made pos- 
ee the correct identification of 74.2 per cent 
of nondelinquent boys and 67.5 per cent of 
delinquent-prone boys. 


Received March 22, 1957. 
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Progressive Matrices (1938) and 
Emotional Disturbance’ 


Sidney Kasper 


Evansville State Hospital 


The Progressive Matrices ( PM), unlike 
other indices of intelligence, has to date re- 
ceived little attention with essentially psy- 
chotic populations. An instrument intended as 
a measure of “clarity of thinking” and “rea- 
soning ability” might legitimately be expected, 
in the presence of illness, to reveal certain 
functional differences, Sensitivities of this 
type are thought evincible in the PM when 
contrasted with a verbal test relatively re- 
sistant to the effects of disturbance, such as 
vocabulary. This paper summarizes: (a) PM 
and the Wechsler Adult Intelligence Scale 
Vocabulary test (WAIS V) relationships to 
morbidity scores derived from the Lorr Multi- 
dimensional Rating Scale for Psychiatric Pa- 
tients (MSRPP) and (b) the relationship to 
morbidity of two points or more deviation be- 
tween expected and actual scores in any of 
PM’s five sets of 12 items each. These devia- 
tions have been thought to possess “Dsycho- 
logical significance,” 

Subjects included 50 Consecutive first ad- 
missions to Evansville State Hospital who had 
not yet attained their 56th year, who showed 
no apparent organic involvements, and were 
capable of complying with instructions.? WAIS 
V scores were prorated and then grouped so 
as to fall within one of three categories: (a) 
below 90 IQ, (b) 90-110 IQ, and (c) above 
110 IQ. PM percentile scores for the same 
subjects were converted and grouped similarly. 


1 An extended report of this study may be ob- 
tained without charge from Sidney Kasper, Evans- 
ville State Hospital, Evansville, Indiana, or for a fee 
from the American Documentation Institute. Order 
Document No. 5431, remitting $1.25 for microfilm 
or $1.25 for photocopies. 

?The, author is especially indebted to Don R. 
Brown for the statistical analysis of the data, 


PM and WAIS V are in 48% agreement. 
Their differences do not permit rejection of 
the null hypothesis and may be attributable 
to chance. Contrary to Prediction, 82% (N 
= 41) of the cases may be described as scor- 
ing as high or higher on the PM than on 
WAIS V, with PM scores being greater in 
34% (N = 17) of the total cases. These find- 
ings are not attributable to differences in age 
or educational attainment and are at variance 
with the expected trend. The -5O correlation 
between PM and WAIS y (p < .05) is essen- 
tially similar to those of previous investiga- 
tions using similar measures with less severely 
disturbed samples or with normals. 

No meaningful relationship is found be- 
tween ratings of morbidity and estimates of 
intellectual functioning. Differences in mean 
morbidity scores for the various discrepancies 
between intelligence measures do not clearly 
demonstrate a concomitant variation between 
events. Similarly, with respect to the specific 
MSRPP scales, “conceptual disorganization” 
and “perceptual distortion,” nonsignificant 
changes in these morbidity scores are asso- 
ciated with differences between intellectual 
measures. The results, then, consistently fail 
to demonstrate PM’s efficiency in discriminat- 
ing the influence of pathology. 

Finally, none of the disparities among PM 
sets of scores is meaningfully related to mor- 
bidity score. Therefore, clinical use of this 
feature of the test would seem severely limited. 


The results, in general, point to consider- — 


able ambiguity and lack of validity in inter- 
pretations of PM scores with heterogeneous 
clinical populations. 


Brief Report. 
Received October 14, 1957. 
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The Polarity of Psychological Tests 


Marshall B. Jones* 


A 
A psychological test may be named after 

, either of its extremes. The same test, for ex- 
ample, might be named either “Rigidity” or 
“Flexibility,” depending upon which end of 
the continuum is to be emphasized. Which of 
the two names we use is common. 
a matter of convention. Implicit in this con- 
vention is the assumption that both ends of 
the continuum are equally meaningful. Con- 
ceptually, however, the dimension we intend 
to measure may be very far from meeting this 


| ly considered 

assumption. “Anxiety” is a good example. We 
recognize immediately that the idea of anxiety 
| 


is far clearer than is the idea of nonanxiety. 


The anxious end of the conceptual continuum 
is more meaningful or, if you like, has a more 
consistent meaning than has the nonanxious 


end. If this difference between the two ends 
ual continuum is reflected in 


he homogeneity of items fall- 
of the continuum will be 
greater than the homogeneity of items falling 


at the other end. Put more specifically, the 
lation among difficult * items 


of the concept 
the test itself, t 
ing at one end 


average intercorre 
will be greater (or less) t 
intercorrelation among easy > 
tent that there is a relationship between item 


> difficulty and average interitem correlation we 


will speak of the test as polarized. The pur- 
pose of this paper is briefly to consider the 
scope and consequences of test polarity. 

1 Opinions or conclusions contained in this paper 
are those of the author. They are not to be con- 
strued as necessarily reflecting the view or the en- 
dorsement of the Navy Department. f 

2 Throug e shall use the termi- 


titude testing in ing to the pro- 
SE i the key to a 


i ersons resp 
pina p erminology of «qifficult” and “easy” 


ae e in the con 
: here does not seem 


testing: but I 
well-understood alternative. 


han the average 
items. To the ex- 


refert: 


US Naval School of Aviation Medicine, Pensacola, Florida 
, 


An Illustration 


A discussion of polarity is i 
troduced by an a epee H 
Survey (4) contains five scales. Four of the 
correspond to familiar clinical ideas: Ansi in 
Dependency, Rigidity, and Hostility.* Each A 
the four scales contains forty items in toned 
choice form, with no item overlap ee 
scales. All four scales are substantially homo 
geneous (Hoyt coefficients ranging from .82 to 
90) and consist of items which most psychol 
ogists would recognize as related to the trait 
the scale is intended to measure. All four 
scales are scored in the neurotic direction 
Thus, a high score indicates Anxiety De- 
pendency, Rigidity, or Hostility. The distri: 
butions of the four scales divide them into 
two pairs: Anxiety and Hostility, which are 
skewed positively, and Dependency and Rig 
idity, which are skewed negatively. To ote. 
trate polarity the items of each scale z 
broken down into four groups accordi Be 
difficulty level. Because of the differenta in 
skew between the Anxiety-Hostility pai and 
the Dependency-Rigidity pair the aes ke 
ae re not do for both pairs. To 16 s 

e Anxiety items, for exam i 
the Hostility items, less een) a i a a 
jects responded in the neurotic x arte hi . 
to none of the Dependency and to onl th a 
of the Rigidity items did less than 30 fee 
spond in the neurotic direction. Fo: fee 
and Hostility, therefore, the item ‘ ae 
vided into items to which less thai yee 
the subjects responded in the oid o 
Ae oa 30% and 40%, peter 
ani fo, an 4 

, and over 50%. For Dependency 


3 The Z survey contains 

ee a fifth 
onomy, which is not included aa og Heter- 
lap with all four of the other scales its items over- 


26 Marshall B. Jones 


Table 1 


Average Tetrachoric Correlations Between Z-Survey 
Items, Grouped by Scale and Difficulty 
Level, Together with the Num- 
bers of Items Involved 


Scale DII 3<pS4 A<PS5 5S<p 
Anxiety 389 (16) .314(11) .235(9) .195 (4) 
Hostility -221 (12) .196(8) 145 (8) 145 (12) 

PSS 5<pPS6 6<pS.7 .7<p 
Dependency .173 (6) .173 (5) .208 (12) .222 (17) 
Rigidity -244 (11) .242(8) .235(11) .313 (10) 


and Rigidity, the items were grouped accord- 
ing as the proportion of subjects responding 
in the neurotic direction was less than 50%, 
between 50% and 60%, between 60% and 
70%, and over 70%. Tetrachoric correlations 
were available between all items of each 
scale. The average correlation within each 
group of items was then obtained. In Table 
1 these averages are presented together with 
the number of items in the group. A glance 
at Table 1 shows that polarity is present.* In 
Anxiety, for example, the smaller the propor- 
tion of people who respond in the anxious 
direction the higher the homogeneity. To a 
lesser degree the same trend obtains for Hos- 
tility. The neurotic ends of these two scales, 
Anxiety and Hostility, are most consistent. 
Precisely the reverse obtains with respect to 
Dependency and Rigidity. The larger the pro- 
portion of persons responding in the depend- 
ent direction, the higher the homogeneity of 
the items. For these two scales, independence 
and flexibility are the more consistent ends 


+ As has already been mentioned, Anxiety and Hos- 
tility are skewed positively, i.e, toward anxiety and 
hostility, while Dependency and Rigidity are skewed 
negatively, i.e., toward independence and flexibility. 
In all four instances, therefore, the direction of skew 
lies toward the more polarized end of the scale. This 
relationship is not accidental. There is an algebraic 
relationship between polarity and skewing. However, 
other variables, e.g., average item difficulty, affect 
skewing as well as polarity. A variable might well be 
skewed and entirely unpolarized at the same time. 
However, to the extent that a test is polarized it will 
tend also to be skewed. Thus, though the two phe- 
nomena: cannot be equated, the existence of skew 
constitutes good reason to look for polarity. 


of the scale, though for Dependency the re- 
lationship is not strong. Polarity, then, defi- ` 
nitely does obtain, at least in the scales of the 
Z survey. However, the nature of the Z survey 
and its construction lead us to believe that 
very much the same results would be obtained 
with other personality questionnaires. 


Homogeneity 


To the extent that a test is pularized we 
may expect the homogeneity of the test to be 
greater (or less) in a high-scoring sample of 
subjects than in a low-scoring sample. This 
proposition asserts the principal pragmatic 
consequence of test polarity. To establish its 
truth let the total score 7; for subject i be 
divided into two components X; and Y;, where 
X; is the subject’s score on the easier half of 
the items and Y; is his score on the harder 
half. In addition, consider two samples of sub- 
jects: a high-scoring sample and a low-scoring 
sample. Most of the subjects in the high- 
scoring sample will answer most of the easy 
items correctly. Therefore, for the high-scor- 
ing group the standard deviation, Sx, will be 
small in comparison to Sy. In the low-scoring 
sample, however, most of the subjects will 
answer most of the hard items incorrectly. 
Therefore, for them Sy will be small in com- 
parison to Sx. Our proposition asserts that if 
the test is polarized the “homogeneity” of the 
test in the high-scoring sample will be differ- 
ent from its homogeneity in the low-scoring 
sample. To come to grips with this proposi- 
tion it is necessary to be more specific about 
homogeneity, which means, essentially, what 
Cronbach (1) has called equivalence, “the de- 
gree to which the test score indicates the sta- 
tus of the individual at the present instant in 
the general and group factors defined by the 
test.” There is a fairly wide choice of co- 
efficients: any one of the Guttman lower 
bounds (2), including the Kuder-Richardson 
(7), an analysis of variance coefficient (3), or 
Loevinger’s homogeneity coefficient (8). The 
proposition at issue could be established with 
any one of these. However, it is most easily 
established with the Kuder-Richardson for- 
mula which is at the same time the most fa- 
miliar of the available coefficients. 

In the low-scoring sample let Sy = KSy, 
where K > 1. For the sake of simplicity we 
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will assume that this relationship is exactly 
reversed in the high-scoring sample, i.e., that 
Sy = KSxy. In both samples the Kuder- 
Richardson coefficient is given by 


-2 ji zes] 
N= OM Sr |’ 


where 2N is the number of items in the test 
(both halves) and where g ranges over all 
2N items. By the algebraic manipulation of 
the formula for rrr we find that 


N-1 Nal — 
oar [eG Vrxx+( acta 


1-+A2+2Arxy 


in the low-scoring sample and that 


{== (N-1 = 
2N [C N Nxt Re N iiim 


2N-1 1+-A?+-2Arxy 


rrr= 


in the high-scoring sample, where 7x.x and řyy 
are the Kuder-Richardson coefficients for X 
and Y respectively and where rxy is the prod- 
uct-moment coefficient between X and Y.° As 
is clear from these two equations, if 7xx and 
yy are equal the homogeneity coefficients in 
the two samples are identical. In this context, 
equality of řyx and ryy is tantamount to no 
polarity, Therefore, if there is no polarity, the 
two homogeneity coefficients are equal. On the 
other hand, if rxx # řyy, polarity exists. In 
terms of the present model degree of polarity 
is given by the difference, rxx — ryy. To the 
extent that vyx is greater than ryy, the homo- 
geneity of the test in the low-scoring sample 
will be greater than its homogeneity in the 
high-scoring sample; and conversely. If a test 
is polarized toward anxiety, for example, the 
difference between two anxious subjects will 


5In these formulas rxy is assumed to have the 
same value in the low-scoring sample as in the high- 
scoring sample; in a similar way, rvy is supposed to 
remain constant in the two samples. These assump- 
tions are tantamount to supposing that X and Y are 
not themselves polarized. However, if the entire test 
(X + F) is polarized, its parts, X and Y, will very 
probably be polarized as well. By assuming that X 
and Y are not polarized we minimize the effects of 
polarity on homogeneity. Polarization within the two 
halves as well as between them would simply rein- 
force the effects on homogeneity of the difference in 
polarity between the hard and the easy halves of the 
test. 


be more reliable than a difference of the same 
magnitude between two nonanxious subjects. 
The implications for tests which are used or 
intended to be used in both clinical and nor- 
mal populations are clear. If the test is polar- 
ized, its internal properties cannot remain the 
same in both populations. If track were kept 
of polarity, we might be able to account for 
some of the instances in which a clinically 
developed instrument “falls apart” in a nor- 
mal population and vice versa. 


Significance 


In order to deal effectively with polarity, 
one must be able to say whether the polarity 
of a given test is statistically significant or 
not. The means about to be described for 
meeting this requirement are manifestly im- 
perfect. However, the problem at issue is not 
simple; there may be no practical yet logically 
rigorous and conceptually adequate way of 
assessing the significance of polarity. 

Table 1 expresses the notion of polarity in 
terms of the average tetrachoric correlation 
within each of four groups of items, the items 
being arranged in order of difficulty. To ob- 
tain a coefficient from these data one needs 
only to calculate a rank correlation coefficient 
(6, 9) between the average tetrachoric ° corre- 
lation within a group and the difficulty level 
of the group. However, with only four groups 
much in the way of significance is not likely 
to be established. The computational load, 
moreover, is considerable. In Table 2 the re- 
sults of breaking the scales of the Z survey 
into groups of three items each are set forth. 
There are 13 groups for each scale, begin- 
ning with the three most difficult items and 
ending with the three least difficult. In all 


6 Throughout this paper tetrachoric coefficients are 
used. Our use of the tetrachoric in preference to the 
phi coefficient needs some justification. The sampling 
distribution of the phi coefficient is not known, How- 
ever, whatever the distribution may be, its expected 
value must be dependent upon item difficulty. If we 
sample from a population with a known value of phi 
the expected value of phi in the sample will depend 
upon the item difficulties of the items involved. The 
idea of polarity, however, turns entirely on the rela- 
tionship between item difficulty and inter-item corre- 
lation. In consequence, the use of the phi coefficient 
would completely confound polarity with statistical 
artifact. On the other hand, the expccted value of the 
tetrachoric coefficient is independent of item difficulty 
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Table 2 


Average Tetrachoric Correlations Within Groups of Three Items Arranged in Order of Difficulty, 


Together with 


the Corresponding Polarity Coefficients, for the Four Z-Survey Scales 


Item Group 
Scale 1 2 3 4 5 6 7 8 9 10 11 12 13 7 
Anxiety 4 4 5 17 47 24 7 3 2 23 n 13 19 54 
Hostility 29 14 12 23 3 2 11 g z 16 04 15 28 .14 
Dependency 16 17 12 17 18 01 28 20 06 08 34 31 36 —.39 
Rigidity 358 20 24 17 30 2 27 20 3 2⁄4 p9 25 52 = LB 


four scales the item which ranked 19th was 
dropped. As is clear from the table, the results 

ield very much the same picture as did the 
Geis set forth in Table 1. However, the 
number of tetrachorics which had to be calcu- 
lated for each scale has been reduced from 
around 200 to 39. At the same time the 2 
available for a test of significance has in- 
creased from four to thirteen. However, even 
with groups of three items each the z for the 
test of significance is small. In Table 2 the 
rank correlations (tau) for the four scales ap- 
pear. Of these, only the coefficient for Anxiety 
is significant. Fortunately, the n can be con- 
siderably increased. It is not necessary to 
treat the entire, undivided sample. The total 
sample may be divided into subsamples, and 
a coefficient calculated which the writer has 
called “a partial rank correlation coefficient” 
(5) and which Torgerson has called “a rank 
correlation coefficient within subgroups” (10). 
In general, the value of the partial coefficient 
will approximate the value obtained with the 
whole sample. However, the standard error of 
the partial coefficient will equal exactly (2)-+ 
times the standard error of the orig 
efficient, where & is the number of sub 
The use of subsamples has the effect 
increasing the n upon which the te 
nificance is based. The number of subsamples 
into which the total may be broken is limited 
primarily by the nature of the tetrachoric co- 
efficient. So many subsamples may not be used 
that one or more of the cells involved in cal- 
culating the tetrachorics became empty, since 
in that circumstance the tetrachoric would not 
be defined. In practice, the actual subsam- 
pling is not needed. The data of Tables 1 and 
2, for example, are based on 310 subjects and 


inal co- 
samples. 
of simply 
st of sig- 


to no item does a majority greater than .85 
respond in the same way. Therefore, the sam- 
ple may be separated into five subsamples of 
62 subjects each with some confidence 
the tetrachorics will retain their meaning. 
standard error for the original taus was .21; 
therefore, the standard error for the partial 
taus will be .115. Since the values of the par- 
tial tau will approximate the values based on 
the entire sample, Dependency is definitely 
polarized. Hostility and Rigidity, -however, 
would seem not on the evidence presented to 
have been established as polarized. For most 
purposes this general method, though far from 
elegant, seems to give an adequate evaluation 
of polarity. 


Summary 


Many psychological traits are polarized in 
the sense that one end of the conceptual con- 
tinuum is clearer, i.e., has a more consistent 
meaning, than the other. In the first section 
of this paper, the four peripheral scales of the 
Pensacola Z Survey were all found to involve 
some degree of polarity. Polarization of the 
scale, Anxiety, was particularly powerful. The 
construction and content of the Z survey is, 
moreover, quite typical of personality inven- 
tories in general. It is, therefore, reasonable to 
suppose that many, if not most, personality 
scales will be found to reflect the polarity of 
the conceptual continuum they are supposed 
to measure. The primary significance of polar- 
ity is that to the extent that a test is polarized 
the homogeneity of the test in high-scoring 
samples will be greater (or less) than its 
homogeneity in low-scoring samples. In the 
second section of this paper this result was : 
established. In the third and last section, a’ 


R 
K 
ai 


4 procedure was proposed by which the degree 
* of polarity a test exhibits can be tested for 
significance. The procedure involves the cal- 
culation of Kendall’s tau between the average 
tetrachoric correlation within groups of items 
and the difficulty of the item group in which 
the tetrachoric average obtains. The tau is 
then tested for significance. 
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An Experimental Group Version for School Children 
of the Progressive Matrices! 


Read D. Tuddenham, Louis Davis, Leslie Davison, 
and Richard Schindler 


University of California 


An experimental sroup test version of Ray- 
en’s Progressive Matrices was prepared by 
reproduction process, to explore 


to .94, 


Tentative percentile norms were presented 
for each Despite the relative 
version and the small 


our own data but differs appreciably from the 


1 An extended report of this study may be obtained 
without charge from Ry D. Tuddenham, Dept. of 
Psychology, University of California, 
Calif., or for a fee from the American Documenta- 
tion Institute. Order Document No. 5429, remitting 
$1.75 for microfilm or $2.50 for Photocopies, 


in magnitude. Sex differences 
be related to test performance, 

Differences between upper-middle-class and 
working-class schools are very substantial and 
highly significant. Despite the novel content 
of Progressive Matrices and its freedom from 
dependence on language, the test reveals 
marked differences between children from dif- 
ferent socioeconomic levels. 

Correlations between Progressive Matrices 
and KuhImann-Anderson, California Mental 
Maturity, and Lorge-Thorndike tests are simi- 
lar in magnitude, clustering around -40 or .45, 
despite an interval of as long as two years þe- 
tween the administration of the two tests cor- 
related. Green and Ewart report similar values. 

In conclusion, the Progressive Matrices 
seem to be well adapted to group testing in 
brief, reliable, and 


vestigated. Our results indicate that a black 


range of difficulty, it is to be hoped that Pro- 
gressive Matrices will soon be made available 
in an inexpensive “throw away” booklet form. 


Brief Report. 
Received October 21, 1957. 
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Test Anxiety Level and Goal-Setting Behavior 


E. Philip Trapp and Donald H. Kausler 


University of Arkansas 


In recent years, the effects of anxiety as a 
drive state have been studied on a diversity 
of activities, ranging from simple motor tasks 
to complex verbal problems (e-8., 1, 3, Ai hs 
9). These studies have been concerned pri- 
marily with the facilitating or inhibiting ef- 
fects of anxiety on performance level. A re- 
lated problem, which has not been specifically 
investigated, is the effect of test anxiety on 
goal-setting behavior. 

This study is primarily concerned with an 
aspect of the relationship between anxiety and 
aspiration level. More exactly, the study in- 
volves a comparison of level of aspiration 
scores (LOA scores) between Ss with high 
test anxiety and low test anxiety over several 
trials on a learning task. The problem may be 
phrased in terms of the null hypothesis, i.e., 
there is no difference between the LOA scores 
of a high test anxiety group and a low test 
anxiety group. 

Method 

dents, approximately the 
h sex in two sections of an 
undergraduate course in abnormal psychology 
at the University of Arkansas, were given the 
test anxiety questionnaire developed by Sara- 
son and Mandler (2, 5, 6). The questionnaire 
was given during regular class periods. The 
Ss were told that the purpose was to measure 
the attitude of students at the university to- 
ward taking various types of tests. The in- 
structions, administration, and scoring of the 
questionnaire followed the procedure outlined 
by Sarason and Mandler. The 28 Ss scoring 
in the upper third for this distribution of 
scores were arbitrarily designated as the high 
test anxiety group (Group HA); the 28 Ss 
scoring in the lower third were arbitrarily 
designated as the low test anxiety group 
(Group LA). 


Eighty-four stu 
same number of eac 
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One week later, the Ss were given an ex- 
tended group form of the Wechsler-Bellevue 
Digit Symbol Test (8). The general instruc- 
tions read as follows: 

The task you are about to do is the digit symbol 
subtest of the Wechsler-Bellevue Intelligence Scale. 
This subtest predicts very successfully total IQ when 
it is administered in an individual setting. We are 
interested in seeing if it can predict as well when 
administered in a group setting. Therefore, it is of 
particular importance that you listen carefully to the 
instructions and follow them accurately. 

It has been found that people either overestimate 
considerably or underestimate considerably their per- 
formance on an ego-involved task such as an intelli- 
gence test. Consequently, you will be asked to pre- 
dict how well you think you will do before taking 
the subtest. 

This study is being repeated in other universities 
throughout the country to see if there are sectional 
differences both in respect to performance on the 
digit symbol test and on ability to predict perform- 
ance. Therefore, make an all-out effort to perform at 
your best. 


The Ss were then presented with a test 
booklet. The front page asked for identifica- 
tion data, such as name, age, etc. Also, space 
was provided for S to record both his estimate 
of his future performance (level of aspiration) 
and his actual performance score (level of 
performance) on each of the four trials he 
received in the test period. The other four 
pages of the booklet were identical. Each page 
contained a copy of the Wechsler-Bellevue 
Digit Symbol Test, increased in length to 75 
unfilled boxes. The standardized instructions 
for the subtest were read to the Ss, and the 
sample set of problems completed. The Ss 
were then asked to turn back to the front page 
of the booklet and record the number of boxes 
they thought they could fill in a minute and 
a half. After each trial, the Ss counted their 
number of completions and recorded the total 
beneath their prediction score. They then 
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Table 1 
Means and Standard Deviations of Groups HA and LA for LOA and LOP Scores by Trials 


Trial 
1 2 3 4 
eS 
Group Score M SD M SD M SD M SD 
z s z7 7 S Ay 
HA LOA 55.21 8.54 57.00 9.73 62.14 8.63 65.07 8.72 
LOP 53.79 9.35 59.61 9.44 64.32 9.40 = — 
LA LOA 56.43 7,34 60.43 6.64 66.50 5.95 69.57 6.64 
LOP 56.14 9.45 63.25 7.74 66.64 10.16 == ss 


made their estima 


between trials was tw 


between the test 


te for the next trial. Time 


anxiety questi 


this testing session. 


The difference betwee 
for the two groups on 


Results 


for significance by the ¢ test. 


Either by treating the trials 


teal differenc, 


Separately or 


€ results support the null 


e in perform- 


ance ability between the two groups on the 
digit symbol test, These findings, incidentally, 
agree, in general, with the results obtained by 
Mandler and Sarason (2) on comparable 
groups also given the Wechsler-Bellevue Digit 


The difference between mean LOA scores 
for the two 8roups was tested for significance 


only trial in which the Ss expressed their as- 
Pirations without prior direct knowledge of 
their performance level. Hence, at the start of 
the testing session there was no real difference 
in the goal-setting behavior of the two groups. 

With knowledge of results commencing on 


Table 2 


Values of ¢ for Differences Between Group 
Means on LOA and LOP Scores 


Trial 
A = 
Score 1 2 3 4 
LOA 56 1.51 2.16* = 2.13* 


LOP 292 1.55 


87 = 
* Significant at the .05 level. 


_ 
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setting behavior of the two groups. Group LA 
consistently displayed a higher level of aspi- 
ration than Group HA. 

Further evidence demonstrating the tend- 
ency of Group LA to set a higher level of as- 
piration following knowledge of results is re- 
vealed in a comparison of composite group 
means. To obtain these means, the aspiration 
scores of each S for the three trials (second, 
third, and fourth) were averaged and the 
mean of these averages determined for both 
groups. For Group HA, the mean was 61.40 
and the standard deviation was 8.29. For 
Group LA, the mean was 65.50 and the stand- 
ard deviation was 5.63. The obtained ¢ of 2.12 
between the means is significant beyond the 
:05 level of confidence. 


Discussion 


The most striking finding in our study was 
the increasing divergence in goal-setting be- 
havior between the two groups on successive 
trials despite correspondingly undifferentiated 
levels of performance and a roughly equiva- 
lent pretest level of aspiration. The differen- 
tial LOA between the two groups reached sta- 
tistical significance on the third and fourth 
trials. This marked tendency of Group LA to 
express higher goal-setting behavior could lead 
to several plausible interpretations. The inter- 
pretation favored by the authors may be 
stated as follows. The high test anxious S, 
while objectively performing no poorer, is 
more condemning and critical of his test be- 
havior than the low test anxious S. In the 
evaluation of his test performance, he then 
tends to overemphasize the negative factors, 
is less optimistic over future performance, and 
expresses this judgment in a relatively lowered 
LOA. As he gains more information or knowl- 
edge of results, his frame of reference becomes 
increasingly slanted in the conservative direc- 
tion. The low test anxious S, on the other 
hand, is subjectively more influenced by his 
success or progress, and is thereby less re- 
strained in his goal-setting behavior. 

It should be noted that both groups func- 
tioned within the realistic range throughout 
the testing. The self-devaluating tendency of 
Group HA did not reach excessive proportions 
because the task was apparently not overly 
frustrating. A more difficult task or even the 


same task given under conditions of high 
stress would be predicted to bring on a pro- 
nounced drop in adaptive behavior and a con- 
comitant expression of an unrealistic level of 
aspiration in Ss with high test anxiety. The 
finding that our two groups did not differ sig- 
nificantly in level of performance is consistent 
with other reported studies in which anxiety 
was the independent variable in learning 
tasks. In a number of related studies, the 
Iowa group has shown that high anxious Ss 
perform relatively better on simple tasks and 
low anxious Ss better on complex tasks. The 
digit symbol test, being of medium difficulty, 

should mask any differences between the two 

groups. Both Mandler and Sarason (2) and 

our study confirmed this expectation. 


Summary 


Eighty-four college students were adminis- 
tered the test anxiety questionnaire developed 
by Mandler and Sarason. They were split into 
two extreme groups on the basis of their 
scores on the questionnaire. The first group 
(Group HA) consisted of Ss scoring in the top 
third of the distribution. The second group 
(Group LA) consisted of Ss scoring in the 
bottom third. Both groups were given four 
trials on an extended group form of the 
Wechsler digit symbol subtest. Prior to each 
trial the Ss expressed their level of aspiration 
(LOA), and after each trial they were given 
knowledge of their own results. A comparison 
of mean LOA scores between the two groups 
was made on each trial, with #’s of .56, 1.51, 
2.16, and 2.13, respectively. The last two 
trials showed significant differences, with 
Group LA reflecting higher LOA scores. A 
comparison of LOA scores between the two 
groups was made by combining the data on 
the last three trials, with the obtained £ of 
2.12 being significant beyond the .05 level of 
confidence. The mean performance scores be- 
tween the two groups were compared for each 
trial, with ¢’s of .92, 1.55, .87, respectively. 
None of the trials showed significant differ- 
ences. When the performance data on all of 
the trials were combined for each group and 
then compared, a ¢ value of 1.37 was obtained, 
which also was not statistically significant. 
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Further Normative Data on the Progressive Matrices’ 


Gerald Sperrazzo* and Walter L. Wilkins 


Saint Louis University 


The normative data on the colored Pro- 
gressive Matrices (1) suggest that clinicians 
should be cautious in the application of 
Raven’s original norms, based on Dumfries, 
Scotland children (4), to American children. 
The data from the Rochester, Minnesota, chil- 
dren reported by Green and Ewert (1) were 
in some respects quite different from the Scot- 
tish data and led to the inference that there 
may have been a notable difference in the in- 
telligence level of children in the Scottish and 
Minnesota schools, or that there was @ differ- 
ence in the socioeconomic levels of the pupils 
of the normative sample, or that unidenti- 
fied factors were producing the difference. 
Prompted by the implication that there were 
differences in productivity on the Progressive 
Matrices in the two samples, we tried to 
Cross validate the two sets of normative data 
with the testing of St. Louis school children. 
As an additional feature of the study, the se- 
lection of the sample was further arranged to 
allow racial background of the subjects to 
affect the results, if it should be a relevant 
factor. 


Procedure and Subjects 


Except for the gross size of the sample, 


replication of the Rochester sample for age 
and grade level was attempted. From the pub- 
lic schools of St. Louis a sample of 480 chil- 
dren was selected and arranged by grade and 
age as shown in Table 1. Sampling took ac- 
count of the fact that St. Louis, sometimes 
described as a border city, contains schools 
with various compositions of Negro and Cau- 
casian pupils. Approximately one-third of the 
children came from a school with an all white 

1 Supported in part by a grant from the Saint 
Louis University Human Relations Center. 

2 Now at the University of Kentucky- 
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pupil population, one-third from a school with 
an all Negro population, and one-third from a 
school with 60% Negro and 40% white popu- 
lation. As a partial control of economic fac- 
tors, the occupations of the pupils’ fathers 
were classified within three levels from the 
Dictionary of Occupational Titles here called: 

A, professional or semi-professional; B, skilled, 
semi-skilled, or clerical; and C, service, un- 

skilled, or labor. For each of these three levels, 

180 pupils were chosen. The nature of the 

sample, then, permitted the identification of 

the source of variance from four variables: 

age, sex, race, and socioeconomic status. 

The Progressive Matrices test was adminis- 
tered in both individual and group form. The 
book form of the test was used for individual 
administration with children between the ages 
of seven and eight. For the older children, 
2 x 2 color slides were made of each matrix 
of the test and projected upon a screen to 
groups ranging in size from 15 to 30. The 
group method of administration has been re- 

orted previously and found to be reliable 
with no significant differences between group 


and individual scores CE) 


Results and Discussion 


While the data upon Minnesota children 
suggested that the Scottish norms were low, 
the results of the 1956 St. Louis testing sug- 
gest that they may be closer to the American 
standard than suspected. Scores reported by 
Green and Ewert for Rochester children were 
consistently higher than Raven’s Dumfries 
scores by two to six points throughout the 
range reported. In St. Louis, however, this 
apparent American superiority is greatly less- 
ened. The scores reported in Table 1 show St. 
Louis medians approximating Raven’s me- 
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Table 1 


Colored Progressive Matrices Scores for St. Louis Children as Compared with 
ji Dumfries and Rochester Children 


Medians 
Age N Range Mean SD St. Louis Dumfries Rochester 

5 81 4-33 17.27 3.74 16 16 21 
ean 41 9-30 18.31 5 01 18 17 3 
8/0-8/5 69 9-33 20.06 5.53 20 18 a 
8/6-8/11 45 7-34 22.44 5.02 23 20 se 
9/0-9/5 51 9-34 23.08 5.76 23 22 re 
9/6-9/11 50 8-36 23.38 7.87 24 24 A 
01/0-10/5 44 10-35 25.20 6.42 26 24 a 
10/6-10/11 29 10-34 24.10 9.44 26 26 A 

11/0-11/5 70 10-36 27.00 5.48 28 28 


dians, with the St. Louis children slightly 
superior at the younger ages and possibly 
slightly inferior at the upper age ranges. 

Inspection of Table 1 indicates that the 
median scores found through this study agree 
more consistently with Raven’s median scores 
than with those from the Rochester study. 
Although the range of difference between the 
median scores of Raven and those of this 
study is from zero to three points, the aver- 
age median score difference is one point. It 
appears, then, that the results found here sup- 
port the validity of Raven’s norms on the 
Dumfries school children for application to 
the St. Louis population. 

Accounting for all the variables which may 
have led to such a notable discrepancy be- 
tween the median scores of the Rochester 
study and the present investigation is rather 
difficult. The socioeconomic status of the 
sample used in Rochester may be relatively 
higher than it would be in Dumfries. If this 
were the case, then an increase in the median 
scores of the Minnesota children would be 
expected since the present study yielded evi- 
dence that the socioeconomic status of the 
subjects can significantly affect the results. 

Table 1 also indicates that the ceiling of 
the test was reached by two age groups. Since 
this has occurred previously in other studies 
(1), it seems rather clear that the ceiling of 
the Progressive Matrices test is apparently 
too low for a common normal pupil popula- 
tion, and a clear differentiation of scores at 
the upper end of the distribution is lacking. 


An analysis of variance was performed to 
study the operation of the age, sex, race, and 
socioeconomic status variables. As a matter 
of convenience the Ss were placed into five 
age groups ranging from seven to eleven years 
of age. Prior to performing the analysis of 
variance, Bartlett’s test of homogeneity was 
applied to the data and no significance was 
found. The results of the analysis are re- 
ported in Table 2. 


Table 2 


Analysis of Variance of Scores from 480 Children on 
Colored Progressive Matrices Test (1947) 


Degrees 
of Mean , 

Source of Variation Freedom Square r 
Total 479 
Age 4 1193.15 46.62* 
Sex 1 80.03 3.13 
Race 1 2116.80 82.72" 
Socioeconomic (S-E) 2 528.26 20.64 
Age X Sex 4 30.62 L97 
Age X Race 4 33.600 13 
Age X S-E 8 24.65 
Sex X Race 1 2i 
Sex X S-E 2 62.76 245. 
Race X S-E 2 210.99 8.25 
Age X Sex X Race 4 4.32 
Age X Sex X S-E 8 13.73 
Age X Race X S-E 8 44.26 1.73 
Sex X Race X S-E 2 45.01 © 1.76 
Race X Sex X Age X S-E 8 51.65 2.02 
Within groups 420 25.59 


-01 level of confidence. 
-05 level of confidence. 


te 


my 


Further Normative Data on Progressive Matrices Bye 


Differences significant beyond the .01 level 

of confidence were found with the age, race, 
and socioeconomic status variables. There was 
no significant difference between the sexes. 
The interaction between race and socioeco- 
nomic status was also significant beyond the 
01 level of confidence, while the third order 
interaction was found to be significant only 
at the .05 level. 
_ The significance found in this analysis mer- 
its some discussion. The test was built to yield 
scores increasing with the S’s age; therefore, 
the significant differences found here with age 
levels require no further justification. On the 
other hand, the test was not designed to dis- 
criminate racial differences. It is apparent 
from the significant race by socioeconomic 
Status interaction and the third-order inter- 
action that a restriction on the interpretation 
of the race difference found is necessary. The 
Measured differences in scores between races 
are related to the age, sex, and socioeconomic 
status of the Ss. The results cannot be inter- 
preted, therefore, as showing differences in 
intelligence between the races tested here. The 
differences found seem to depend upon varia- 
tions of the nonrace factors. 

Product-moment correlation coefficients 
Were computed between the Progressive Mat- 
rices and three standard intelligence tests, 
Utilizing the scores from recent school testing 
of the pupils. With the Otis Quick-Scoring 
Intelligence Test the z was .23 (N of 36), 
with the California Test of Mental Maturity 
it was 30 (N of 137), and with the Kuhl- 
mann-Anderson it was .41 (W of 215)- 


Summary and Conclusions 


The Colored Progressive Matrices Test was 
administered to 480 St. Louis school children, 
ranging in age from seven to eleven years: The 
subjects were selected from three St. Louis 
public schools. One was an all-Negro school, 
another an all-white school, and the third en- 
rolled both white and Negro children. Three 
levels of socioeconomic status, based upon the 


occupation of the father, were established for 
purposes of comparison. The first category 
included professional and semi-professional 
workers; the second, skilled, semi-skilled and 
clerical workers; and the third, laborers, un- 
skilled, and service workers. 

The test was administered individually in 
book form to seven- and eight-year-old chil- 
dren. In the group administration, 2 X 2 color 
slides were projected to 9- to 11-year-old sub-, 
jects in groups of 15 to 30. 

The findings lead to the following conclu- 
sions. 

1. The norms established by J. C. Raven 
for the Progressive Matrices appear to be 
valid for application to the population repre- 
sented by the sample in the present study. 

2. There is some indication on the basis of 
the range of scores, that the ceiling of the 
test is too low for a population of average 
children. 

3. Differences significant beyond the .01 
levels of confidence were found between the 
various age levels (seven to eleven), between 
races (white and Negro), and between socio- 
economic levels. There was no significant dif-. 
ference between the sexes. 

4, The Progressive Matrices Test showed a 
correlation with the Otis Quick-Scoring test of 
.23, with the California Test of Mental Ma- 
turity, 30, with the Kuhlmann-Anderson, .40. 
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The Achievement Motive and Field Independence’ 


Jack Wertheim and Sarnoff A. Mednick 


Harvard University 


McClelland eż al. ascribe the origins of the 
achievement motive to the “different experi- 
ences which children have” (2, p. 288). More 
specifically, they state that “mothers of sons 
with low need achievement tend to demand 
less in the way of independent achievement 
at an early age, and tend to be more restric- 
tive than other mothers” (2, p. 302). An in- 
teresting parallel may be seen in Witkin’s de- 
scription of the developmental precursors of 
field dependence; he states “field dependent 
children have been subjected during growth 
to strongly restrictive parental pressures” (4, 
P. 87). He also points out that these parents 
tend not to demand independent behavior 
from their children. 

The elements of similarity in these writers’ 
descriptions of the developmental origins of 
these two personality variables suggested that 
an individual’s scores on the tests of these fac- 
tors should be related. More particularly, it 
was predicted that there is a positive cor- 


relation between field independence and need 
achievement. 


Method 


Forty-two undergraduate Ss (31 female, 11 male) 
were tested for need achievement (n-Ach) and field 
independence (FI) in that order. Ss took the n-Ach 
test in groups of three each, They were shown four 
slides projected on a screen for 20 sec. each and 
were asked to answer questions about the slide. As 
a representative of the FI test battery, a short form 
a) of the Embedded Figures Test (EFT) was ad- 
ministered. § was shown a complex geometric figure 
followed by a simple figure and then asked to find 
the simple figure in the complex figure. 

Detailed descriptions of procedure and materials 


relative to these tests may be found elsewhere G 
2, 3). 


1 The help of Drs, McClelland and Witkin in sup- 
plying materials and assistance is a 


ppreciated. 


Results and Discussion 


The scoring of the n-Ach material was done 
by a trained scorer whose scoring reliability 
has been in the .90’s in previous tests. The 
higher an S’s score, the greater his n-Ach. The 
scores ranged from — 4 to + 13, with a mean 
of 3.4. S’s score on the EFT was his total 
time to locate the embedded figures on all 12 
cards. In this case, the lower S’s score, the 
greater his field independence. The scores 
ranged from 120 to 955 sec., with a mean of 
462.8 sec. 

The product-moment correlation between 
n-Ach and EFT scores was — .40 (p < .01), 
indicating a significant relationship between 
the two variables; the higher the achievement 
motive, the greater the field independence. 

It is interesting to note that the similar- 
ity in the descriptions of the developmental 
origins of these two personality traits is re- 


flected in the observed relationship of the 
variables in adults. 
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Assimilation, Failure-Avoidance, and Anxiety’ 
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The aims of the present investigation were 
(a) to develop a scale measuring the tendency 
to assimilate negative information and (b) to 
study the relationship of this assimilation 
tendency to other personality measures and 
to behavior in a problem-solving situation. 

In an earlier series of investigations (4) it 
was found that a subject’s (S’s) behavior in 
an actual situation of failure was related to 
his interpretation of failure as measured by & 
paper-and-pencil “situational interpretation” 
test. In this test, S was confronted by a series 
of hypothetical negative situations (failure or 
criticism) and instructed to select one of two 
alternative interpretations following each situ- 
ation: one alternative represented self-nega- 
tion or decreased self-evaluation (e-8-, “This 
shows I might not be so good”) and the other 
alternative represented an opposing interpre- 
tation of self-affirmation without any change 
in self-evaluation (e.g., “This is too difficult 
for anyone to do”). The latter alternative was 
descriptively regarded as a “fajlure-avoidant” 
interpretation because of its implied refusal to 
accept the possibility of failure. The behav- 
ioral measure involved S’s attempts to solve 

1'The work described in this paper was supported 
from the Na- 
National In- 
stitutes of Health, Public Health Service, and in part 
under Contract Nonr-1858 (12) sponsore by the 
group psychology branch, Office of Naval Research. 
We are greatly indebted to the staff mem! 
participating schools and camps in Connecticut, New 
York, New Jersey, and Pennsylvania for their gener- 
ous cooperation. We would like to express our ap- 
preciation especially to Ronald s. Wilson for his 
help in coding responses and analyzing data, and also 
fee ohn McDavid, Jr. for his assistance in collecting 
ata. 


M. Schroder 


n University 


a problem under increasing failure stimula- 
tion. The tendency for S to “leave the field” 
by selecting a different goal when failing to 
reach the initial goal was regarded as “failure- 
avoidant” behavior. 

Ss utilizing failure-avoidant interpretations 
on the situational test were found to be much 
more likely to utilize failure-avoidant behav- 
ior in the problem-solving situation. In dis- 
cussing this relationship, it was noted that the 
failure-avoidant interpretation process may 
effectively prevent the occurrence of assimila- 
tion; that is, in order to be assimilated, a 
negative event must first be accepted, at least 
provisionally. An individual experiencing a 
failing score or 4 critical remark must first 
categorize the event as possibly true before 
he can undertake any adaptive modification. 
He must say, in effect, “I may be wrong” be- 
fore he can ask, “How can I correct myself?” 
The provisional acceptance of negative infor- 
mation and the subsequent self-modification 
are both viewed as aspects of the assimilation 
process. 

In previous work we have assumed that 
avoidance and assimilation represent opposing 

oles on a process continuum but have not 
verified this assumption by establishing its 
relationship to other measures. Therefore, in 
the present investigation a direct eects of 
the assimilation tendency was developed in 
order to study the assimilation characteristics 
both general and specific, of groups distin- 
guished in terms of certain personality and 
behavioral variables. Following leads from 
the findings of other investigators (2), the 
relationship between anxiety and assimilation 
was also explored. The following hypotheses 
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concerning general tendencies to assimilate 
negative informations were tested: 

I. Persons who give avoidant interpreta- 
tions score lower in assimilation tendency 
than persons who give nonavoidant interpre- 
tations. 

II. Persons high in anxiety score lower in 
assimilation tendency than persons low in 
anxiety. 

III. Persons who show failure-avoidant be- 
havior score lower in assimilation tendency 
than persons who show nonavoidant behavior. 


Method 


The assimilation scores were derived from 


sentence completion responses given to nega- 
tive stems. 


Combining the advantages of 
structured materials with freedom of response, 
the Sentence Completion Method (SCM) ap- 
peared most appropriate for present Purposes. 
According to the Provisions for scoring, two 
individuals May receive the same assimilation 
Score by giving quite different responses, es- 
pecially in nonassimilation where the range of 
defensive possibilities such as aggression, de- 
nial, etc., is quite varied. In addition to pro- 
viding an over-all score for general assimila- 
tion tendency, the SCM responses could also 
be later reconsidered to note any specific fea- 
tures of assimilation or nonassimilation which 


might characterize the groups under consid- 
eration, 


Subjects and Procedure 
The SCM was administered to approxi- 


mately 800 white boys between the ages of 
13 and 18 during 1955. Gro 


any time limit), followed 


Consisting of 20 
vocabulary items, These 800 Ss will be con- 
sidered according to the following four 
samples: 

Sample A 


500 Ss drawn from YMCA 
camps, Boy Scout camps, public and Private 
schools. 


Sample B: 79 Ss attending a Parochial 
Purposes of raising their 


Sample C: 60 Ss ‘Tepresenting the entire 


junior and senior class in a consolidated high 
school. 


Sample D: 160 Ss drawn from sources 
similar to Sample A. 

For certain cross-validation purposes, SCM 
responses of selected Ss from 880 boys tested 
during 1956 were used (Sample E). 


Materials 


The five sentence stems, representing hypo- 
thetical situations of criticism and failure, are 
listed below. The number indicates the posi- 
tion of the stem in relation to the total 30 
stems which each S completed. 

Criticism: 

4. When someone criticizes me 

19. If someone says I’m wrong 

29. If someone says I have done poorly 
Failure: 

9. When I fail 

22. When things go wrong 


Development of Assimilation Scale 


Obtaining an assimilation score from five 
SCM responses required three steps: coding 
each response according to an objective sys- 
tem; transforming each coded response into 
an assimilation score; and summing the five 
scores to yield a total assimilation measure. 

Coding system. The system developed for 
coding SCM responses objectively was in- 
tended to minimize the number of categories 
and maximize the amount of information re- 
tained. The categories, given below in the As- 
similation scale, were described in a manual 
with examples for each category. Agreement 
between three judges 2 in coding 260 responses 
was 93 per cent. In coded form, the responses 
could not only be easily transformed into an 
assimilation scale, but were “recoverable” for 


analysis at a more specific level than as- 
similation. 


Assimilation scale. 
was assigned an assim 
to the following three- 
the explicit statemen 
that S would show a: 
modification in his b 


Each coded response 
ilation score according 
Point scale, in terms of 
t or implied likelihood 
ssimilation or integrated 
ehavior as a result of the 


_ 7 Ronald S. Wilson ani 
judges along with on 
assistance is gratefully 


d Roger C. Porr served as 
e of the authors, and their 
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hypothetical negative event described in the 
sentence stem. 


o aae Sire De Any form of denial; negative feeling 

eA ER ; antenna rejected; pessimistic per- 

a Aai sae reciprocation ; seli-disclaimed 

Bh ona attributed causality ; cessation of, disruption 
, ecreased effort in behavior. 

Pi Sgt is Interaction accepted or questioned; 

e a perception of interaction; attention to in- 

uy he conforming reaction to other; cognitive ac- 

y; behavior repeated; effort maintained. 

we Score i Self-attributed causality; behavioral 

aa ication through either compensation or correc- 
n; effort increased. 


. Transformation from coded responses to as- 

similation scale could be accomplished with 
almost perfect judge agreement. When the 
separate scores for the five SCM items were 
summed, an assimilation scale score (ranging 
from 0 to 10) was obtained for each S. The 
mean assimilation scale score for 107 ran- 
domly selected Ss in Sample A was 4.76, SD, 
2.34. Assimilation scores were not related to 
scores of verbal intelligence. 

Reliability. Two SCM forms were adminis- 
tered to Sample C at a six-month interval. 
Since the forms changed slightly, there were 
only three identical negative stems occurring 
on both forms (“When someone criticizes me,” 

When I fail,” and “When things go wrong”). 

Computation of six-point assimilation scores 
based on these three stems for both forms 
yielded a test-retest reliability coefficient of 
-64 (N = 48), which was estimated (by Speat- 
man-Brown prophecy formula) to be .75 if 
based on five, rather than three, stems. 


Identification of Extreme Groups 


Failure-avoidant interpretation. This vari- 
able was defined by the score on the criticism- 
failure subscale of the Situational Interpreta- 
tion Experiment (4). Each of the ten items 
on this subscale presented a hypothetical situ- 


ation of criticism or failure with instructions 
for S to select one of the two alternative 
te the thought 


Paises that would best indica 
e would have in that situation- The total 
number of self-negating OY «nonavoidant 


choices was added to obtain S’s score so that 
a low score indicated a greater tendency to 
From Sample 


ee avoidant interpretations. “"” 
, a failure-avoidant interpretation group 
(scoring 0 to 2) of 19 Ss and a nonavoidant 


interpretation group (scoring 10) of 31 Ss 
were selected (see Table 3 in reference 4 for 
distribution of scores). Elimination of one S 
from each group because of an incomplete 
SCM left 18 and 30 Ss, respectively, or ap- 
proximately the lower four per cent and the 
upper six per cent of the distribution. 
Manifest anxiety. This variable was defined 
by the score on the Taylor Manifest Anxiety 
Scale (5). From Sample B, a low anxiety 
group (scoring 2 to 8) of 11 Ss and a high 
anxiety group (scoring 28 and above) of 11 
Ss were selected representing the lower and 
upper 13 per cent of the distribution. 
Failure-avoidant behavior. This variable 
was defined as the extent to which S avoids 
a situation in which he is receiving gradually 
increasing failure by selecting a different goal 


rather than continuing to strive toward the 
same goal (4). From Sample C, a behavioral 
ho avoided 


failure-avoidant group of 14 Ss w. 
the situation at the earliest signs of failure 


and a behavioral nonavoidant group of 14 Ss 
who remained in the situation through all 12 
trials were selected, representing the upper 
and lower 29 per cent of the distribution. 


Results 


Assimilation Scale 

Hypothesis I. Failure-avoidant interpreta- 
tion. AS indicated in Table 1, the mean as- 
similation score for the avoidant interpreta- 
tion group is significantly lower (< .01) than 


Table 1 
Assimilation Score Comparisons of Extreme Groups 
Assimilation 
Hypoth- Extreme Score 
esis Group Mean t df p* 
I Failure-avoidant 3.06 
interpretation 2.99 46 <.01 
Nonavoidant 5.17 
interpretation 
II High anxiety 2.27 
545 380 20 <01 


Low anxiety 


TL Failure-avoidant 4.01 
behavior 

Nonavoidant 5.94 
behavior 


1.61 26 <.10 


* By one-tailed test. 
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the mean for the nonavoidant group. Extreme 
groups on this interpretation measure were 
selected from Sample D in an attempt at rep- 
lication. In this sample, the mean of 21 avoid- 
ant Ss scoring 0-3 (lower 9 per cent) was 
lower, but not significantly so (p < -10, one- 
tailed test), than the mean of the 27 non- 
avoidant Ss scoring 9-10 (upper 18 per cent) 
(= 1.55, df = 46). A nonsignificant Pear- 
sonian r of .12 was obtained between these 
two measures on 107 randomly selected Ss, 
indicating that whatever relationship exists is 
limited to extreme groups. 

Hypothesis II. Anxiety. The mean assimi- 
lation score for the high in manifest anxiety 
group is significantly lower (< .01) than the 
mean for the group low in anxiety. This in- 
verse relationship is also supported by signifi- 
cant correlations in the samples: r = — .32 
for 79 Ss in Sample B (< 01) andr = — .28 
for 32 Ss in Sample A for whom anxiety scores 
were available (< 05). 

Hypothesis III. Failure-avoidant behavior. 
The hypothesis concerning avoidant behavior 
Was not supported, although the difference be- 
tween assimilation Scores was in the predicted 
direction (Ż < .10). A test of this hypothesis 
in another sample also failed to confirm it. 


Specific Assimilation Characteristics of 
Extreme Groups 


The coded SCM responses were examined 


for more specific characteristics of assimila- 


tion or nonassimilation in each group, and two 
SCM code categories, denial and aggression, 
were identified as potentially differentiating. 
The denial code included the negation of feel- 
ing (“I don’t mind”) and negation of aggres- 
sion (“I don’t get mad”) as well as denial of 
attention to the source of negative informa- 
tion (“I ignore them”). The aggression code 
included explicitly hostile responses (e.g., “I 
get mad,” “I blow up”), These measures were 
recorded simply in terms of occurrence or 
nonoccurrence on any one of the five SCM 
stems. Incidence of denial and aggression was 
17 and 14 per cent, respectively, for 107 ran- 
domly selected Ss. 

In addition to these two SCM measures, an 
index of the incidence of self-correction was 
also available for the extreme groups differen- 
tiated with respect to failure-avoidant behav- 
ior. A situation of academic failure was de- 
scribed and S was instructed to imagine that 
he was in the situation and then write down 
his first reaction. Self-correction was coded 
for responses such as “Find out what I did 
wrong” or “Find out my mistake,” and oc- 
curred for 21 per cent of Ss in Sample C. 

Failure-avoidant interpretation. The avoid- 
ant interpretation group gave significantly 
more (< .01) denial responses than the non- 
avoidant interpretation group, but did not 
differ in aggression, Extreme groups were se- 
lected from Sample E to attempt a replication 


Table 2 


Specific Response Comparisons of Extreme Groups 


Incidence of Incidence of Incidence of 


Denial Aggression Self-correction 

Extreme Group N on SCM on SCM on First-reaction 
Failure-avoidant interpretation 18 39 11 i 

a t F ` Not available 
Nonavoidant interpretation 30 0 AS. Not available 
Corrected x? 9.59** r= ji 
ry 11 18 72 Not available 
Come 7s 11 18 ie Not available 
Failure-avoidant behavior 
Nonavoidant behavior a FA = 
Corrected x? S ji ge 

= Ds. 

Nol cit Square'computed by actual number of Ss rather than by proportions 
* Dp < 01 
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of this defense-specific finding, but no differ- 
ence in denial was found. 
; Anxiety. Although no difference in denial 
is noted between anxiety groups, the high 
anxious group gave significantly more (<.05) 
aggressive responses than the low anxious 
group. From 245 Ss in Sample E with anxiety 
scores available, the upper and lower 13 per 
cent were selected, and this anxiety-aggression 
relationship was successfully replicated (cor- 
rected x? = 4.22; dj = 1; p= < .05). 
Failure-avoidant behavior. The behavioral 
groups differed only in seli-correction, this re- 
sponse occurring significantly more often (< 
.05) in the nonavoidant behavioral group than 
in the avoidant group. First-reaction measures 
Were not available in other groups for repli- 
cation. It might be noted that self-correction 
did not occur with sufficient frequency on the 
SCM to provide a basis for discriminating 


between groups. 
Discussion 


We have assumed earlier (4) that assimila- 
tion and failure-avoidant interpretation rep- 
resent opposing poles on a continuum of re- 
actions to negative events. However, this as- 
sumption is called into question by the failure 
to replicate Hypothesis I ($ < 10). This 
Nonsignificant difference may have resulted 
Partially from the fact that the groups used 
for replication were less extreme in their 1n- 
terpretation scores (0-3 vs. 9-10) than the 
initial extreme groups. As we have discussed 
elsewhere (4, p. 19), the interpretation test 
Was designed primarily to identify Ss iene 
in their interpretation tendencies rather than 
to measure a continuously distributed charac 
teristic, Therefore, scores in the middle range 
(even as low as 3) are accordingly imprecise. 
Therefore, rather than inferring am avoidance- 
assimilation continuum, it seems safer to 
Conclude that Ss who are extremely avoid- 
ant will have a very low tendency t9 assimIr 
late negative information. That is, if we be 
the mean assimilation score of 107 randomly 
Selected Ss (4.76) as an estimate of the as- 
Similation base rate, the avoidant interpreta- 
tion mean score (3.06) is significantly lower 
than this group base rate (t= 2.90, ? < ol). 

Similar to the present constructs of assimi- 
lation and avoidance, though used in a differ- 


ent context, are the processes of assimilation 
and contrast recently described by Hovland, 
Harvey, and Sherif (1) to account for individ- 
ual variation in attitude change studies. Using 
communication statements as stimuli rather 
than the hypothetical negative events pres- 
ently employed, these authors demonstrated 
that Ss taking an extreme stand on a given 
issue have narrower “latitudes of acceptance” 
for statements which differ from their own on 
an issue. When exposed to such differing state- 
ments, these Ss with extreme attitudes were 
found to reject the communication by con- 
trasting it to their own position rather than 
by assimilating the communication. In a dif- 
ferent stimulus realm, our avoidant interpre- 
tation Ss may be regarded as “contrasting” 
negative information by their use of some 
nonassimilative maneuver, such as denial, 
which may represent a narrow range of ac- 


ceptance. m ads 
Although the greater incidence of denial in 
vould be congruent 


avoidant interpretation Ss w 
with the assumed underlying blame-avoidant 
tendency, this defense specific relationship 
must be regarded as highly tentative since 
replication was unsuccessful. It seems likely 
that the denial category requires more precise 
response referents and more careful attention 
to situational (or stem) specific determinants. 
On the basis of the successful replications 
in both instances, the tendency for anxious Ss 
to be “low assimilators” and, more specifi- 
cally, to give more aggressive responses ap- 
pears reasonably well established for the pres- 
ent population. That the high anxious Ss do 
not give more denial responses than the low 
anxious Ss is not surprising when one con- 
siders that denial would very likely prevent 
the admission of anxiety in the testing situa- 
tion. The greater incidence of aggressive re- 
sponses, but not denial, in high anxious Ss 
agrees with earlier findings employing two 
similar instruments. In reporting correlates of 
the Test Anxiety Questionnaire, Sarason and 
Mandler (3) noted a significant correlation 
between test anxiety and the aggression sub- 
scale of the Child-Waterhouse Interfering 
Tendency Questionnaire (7) (r= .29; N= 
62; p < .05). However, in considering the de- 
fensive subscale which from its definition— 
“need to justify or rationalize away one’s fail- 
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ures” (7, p. 301)—appears to be similar to 
denial, the correlation to test anxiety did not 
approach significance. A 

The present results do not permit anchoring 
the assimilation tendency in behavior, al- 
though the assimilation scale differences be- 
tween extreme behavioral groups were in the 
hypothesized direction. Although data were 
not available for replication, the greater in- 
cidence of a specific form of assimilation— 
self correction—in nonavoidant behavioral Ss 
appears quite reasonable. That is, these Ss 
(who may be regarded as “persistent”) were 
selected on the basis of their remaining in the 
problem situation utilizing failure cues as in- 
formation for developing new solutions, a be- 
havior which would presumably require some 
process of self-modification. 

Primarily because of its free response char- 
acteristic which allows the recovery of re- 
sponses for more specific analysis such as is 
summarized in Table 2, the SCM, particularly 
in its highly structured present form, appears 
to provide a potentially valuable method for 
the initial exploration of problems in this area. 


Summary 


A scale measuring the tendency to assimi- 
late negative information was developed, 
based on SCM responses of 800 white boys 
between the ages of 13 and 18. Assimilation 
scores were obtained from responses to five 
SCM stems structured as negative situations 
(e.g., “When someone criticizes me . . .”) by 
three steps: (a) coding each response accord- 
ing to an objective system (inter-judge agree- 
ment = 93%); (b) transforming each coded 
response into an assimilation scale score (a 
three-point scale based on the likelihood that 
S would integrate the negative event into sub- 
sequent behavior) ; and (c) summing these 
five scores. Corrected test-retest reliability for 
the assimilation score over six months = .75, 

Subgroups of Ss representing extremes on 
three other measures were identified in order 
to test assimilation hypotheses: Taylor anxi- 


ety scale; failure-avoidant interpretation meas- 
ure (tendency to avoid interpreting negative 
events as failure); and failure-avoidant be- 
havior. The results were as follows: 

1. Ss high in anxiety scored significantly 
lower in assimilation tendency and gave sig- 
nificantly more aggressive responses than Ss 
low in anxiety. ' 

2. Ss who showed nonavoidant behavior 
gave significantly more self-correction re- 
sponse than Ss showing failure-avoidant be- 
havior. 

3. Ss who gave avoidant interpretations 
scored lower in assimilation tendency than Ss 
giving nonavoidant interpretations, but this 
difference was not successfully replicated. 

These findings were considered in relation- 
ship to earlier assumptions regarding assimi- 
lation and avoidance; to other similar con- 
structs (assimilation and contrast); and to 
other similar measures (Interfering Tendency 
Questionnaire). The potential value of the 


SCM for investigating problems in this area 
was noted. 
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oe of the reliability of correla- 
ee aaa on Q sorts does not appear to 
i een systematically investigated. The 
dude age of Q sorts would seem to pre- 
thoi possibility of determining reliability 
ore igh the usual approaches of alternate 
E ns, matched items, and split halves. In a 
ee Q-sort experiment, an individual indi- 
fon bay degree to which each item of a group 
in DES OF corresponds to the object or value 
aa o For example, in a self sort, he 
felt th Sort statements according to how he 
would ey described him; in an ideal sort, he 
ave d sort them as he would like to be. Since 
tian is no advance knowledge of his concep- 
Sc of himself, it would be impossible to con- 
or T alternate forms, to match statements, 
of o split a group of statements into halves 
of equal significance for each individual for a 
a frame of reference. The object toward 
y nich attention is being directed would differ 
niquely for each person, since each is evalu- 
ating himself. 
3 $ t seems an inescapable conclusion that no 
olution exists. Perhaps the restriction 1M- 
Posed by adherence to the usual methods Cre- 
a he problem. Reliability is a matter oO 
gh importance. It reflects consistency ° 
ee coment and stability of performance. 
ar are not sure of the: degree: Of -consistera 
ae measurement, we are faced with ambiguity 
evaluating the changes which our instru- 
ak may reflect. The criterion of success aS 
o reliability is the correlation between results 
obtained on two or more performances with 
an instrument or its comparable form. The 
Method proposed here results in a high de- 
gree of consistency among 20 alternate forms 
Chosen entirely on a random basis, with no 
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prior evaluation of a single item of any of the 
20 forms. The author has found no evidence 
in the literature of the use of this approach 
as a means of achieving consistency of meas- 
urement or stability of performance. Since the 
method proposed is not one of those usually 
employed, the question might be raised as to 
whether this is a measure of reliability. The 
question might also be raised as to whether 
the concept of reliability should be broadened 


to include the method used here. 


A Universe of Personal Concepts 


Any method based on matching or weight- 
ing items offers a most serious difficulty. Pre- 
determination of values of individual items 
for Q sort does not seem feasible. A different 
approach seems indicated, one which could re- 
sult in comparability of results by virtue of 
the method by which groups as a whole 
are selected. One possible approach would be 
based on sampling theory. Unbiased samples 
of statements from a clearly defined universe 
should yield results which are comparable be- 
tween the groups so selected. The question, 
then, is the definition of the universe. The 
number of universes from which a selection 
could be made is incalculable. The first con- 
sideration would appear to be the broad na- 
ture of the universe, that is, would it involve 
any particular dimensions such as person- 
ality traits, or concepts of accepted clinical 
importance, or the formulations of some theo- 
retical approach to personality? Whether or 
not there is merit in the avoidance of par- 
ticular dimensions characterizing a universe of 
statements depends in part upon the use for 
which the universe is intended. Perhaps of 
greater importance is the difficulty of defining 
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any universe with specific dimensions so that 
all possible members of it may be accounted 
for and identified. It is not implied that a uni- 
verse can be established without any dimen- 
sions. At least one is necessary in order to 
establish a boundary within which all mem- 
bers would lie. The dimension chosen was 
that of difficulty. The universe consists of 
statements based on words not above the 
sixth-grade level. It would seem unwise to 
confront the majority of the population, par- 
ticularly the Psychological deviates, with 
statements employing words beyond the sixth- 
grade level. The use of easy words is not 
merely a practical consideration; it js essen- 
tial, to reduce to a minimum the distortions 
which might affect results through lack of 
understanding. No matter how technically 

ation of human reaction might 


are based are at the sixth-grade level of diffi- 
culty or below. 


The members of a univer: 
be identified on an objective 
the use of Thorndike and Lorge’ 
ers Word Book of 30,000 Words (4). Part I 


P- xi), words with 
million may 


“grade level or 
92 words are So classified: at 


be taken as being at the sixth 
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to formulate a statement of human reaction, 
behavior, feeling, thinking, etc. At the present 
stage of endeavor, it does not seem best to 
state the basis more specifically. Such a for- 
mulation is designated a personal concept. 
Whenever a dictionary definition provided a 
formulation of a Personal concept, it was ac- 
cepted for inclusion in the universe. In some 
instances, a difficulty presented itself in that 
many meanings were given for some words; 
for example, 40 meanings were given for the 
word “set.” The selection of meanings used in 
this dictionary was stated to be based On 
Lorge’s English Semantic Count (3, p. vii), 
in which the frequency of each meaning was 
counted. It was the use of a semantic fre- 
quency count which prompted the use of this 
dictionary in the present method. The order 
of arrangement of the meanings of a word 
was such that common and general meanings 
were put before rare and special meanings 
and present-day meanings put before archaic 
meanings. Thus, in Cases where several mean- 
ings were listed, a consistent and relatively 
objective basis was Provided for selection of 
the meaning to be used. Where more than one 
definition could be used as a basis for a per- 
sonal concept, the one selected was the first 
one in the order listed, This procedure tended 
to bring into the formulations comprising the 
universe the Meanings most frequently em- 


Ployed and likely to be most easily under- 
stood. 


As an example, the words which were indicated to 
occur 10 or more times per million words on Page 1, 
Column 1, of the The Teacher’s Word Book of 30,000 
Words (4) were: abandon, abbey, abbot, abide, — 
ability, able, aboard, abode, abolish. Following the 
procedure indicated above, three of these were used: 
The respective formulations 
hese words were: “I yield 
gs,” “I stand firm on my 
ideas,” “I am an able Person.” Selecting another page 
at random, the words indicated on Page 94, Column 
1, were: improve, improvement, impulse, in. Two of 
these were used: improve and impulse, for the fol- 


lowing formulations: “I seek to improve myself,” 
and “I act on impulse.” 


Following this procedure throughout the en- 
tire dictionary, a total of 1575 statements 
were formulated. The Tesults of the first en- 
deavor were set aside for a period of weeks, 
then carefully reviewed in their entirety to 
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obtain a fresh approach. After another pe- 
riod of several weeks, they were reviewed a 
third time. In the compilation which consti- 
tutes the Universe of Personal Concepts 
(UPC) (2), these statements were printed in 
serial order, each page (but the last) having 
50 statements, for a total of 32 pages. The 
statements on each page were numbered from 
O1 to 50, and the pages from 01 to 32. For 
example, the 20th statement on Page 3 was 
numbered 0320, “I trust people”; and the 
35th statement on Page 6 was numbered 
0635, “I am a coward.” 


Random Sets of Personal Concepts 


With a Universe of Personal Concepts at 
hand, it was a simple matter, with random 
decimal digit tables (5), to obtain random 
Sets of statements from the UPC, which have 
been designated Random Sets of Personal 
Concepts (RSPC). By careful adherence to 
the principles of random selection, some de- 
gree of confidence may be placed in each 
RSPC as a representation of the preferred 
Meanings in the entire dictionary, within a 
Siven level of simplicity or difficulty. Within 
the limits of experimental error, some degree 
of confidence may also be felt that results ob- 
tained on one set of RSPC will agree with re- 
Sults obtained on any other RSPC and with 
the results on the UPC. Furthermore, the ex- 
Perimenter is now in a position to determine 
the limits of error of measurement. 

Random Sets of Personal Concepts were 
selected from the UPC through the use of & 
decimal digit table (5). Selecting a point at 
random to enter the table, and moving hori- 
zontally to the right, four digits were taken at 
a time. The first pair of digits indicated the 
page of the UPC; the second pair, the num- 
ber of the statement on that page. At each 
drawing, therefore, each statement in the 
UPC had an equal opportunity to be selected. 
This procedure was repeated until 50 state- 
ments were drawn, the number which had 
been decided upon for each RSPC. Twenty 
RSPC were drawn. The same personal cone 
cept could appear and did appear 1" different 
RSPC. On one occasion the same statement 
was drawn twice in succession for the same 
RSPC; the second drawing was ignored. Each 
statement was printed on a card 1” X 22", 


with a code number corresponding to its seria 
position in the RSPC, to facilitate recording 


Testing Sampling Reliability 


In its broader sense, reliability is not to bi 
conceived of simply as the correlation be 
tween two instruments or the correlation be- 
tween two applications of the same instru- 
ment. The concept of reliability is embraced 
in a most fundamental sense when there is 
consistency between unbiased samples from a 
clearly defined universe and between these 
samples and the universe. Seldom is the in- 
vestigator in a position to define the bounda- 
ries of a universe clearly and to identify all 
the members of the universe so that each has 
an equal chance of being drawn in any selec- 
tion for a sample. When that situation does 
exist, the experimenter is in a position to de- 
termine parameters, that is, relationships in- 
volving the universe, in addition to statistics, 
that is, relationships involving samples and 
the universe. Stated in general terms, then, 
the hypothesis is advanced that the correla- 
tions obtained on Q sorts with RSPC will 
agree with the correlations obtained on Q 


sorts with the UPC. 


Procedure 


ubjects in this experiment were four 
Meee t students in psychology at Wash- 
ington University.* , : 

The correlations involved three kinds of re- 
lationships on each RSPC: (a) 7’s between 
self concept and ideal concept (intra-indi- 
vidual, S-I), (b) 7’s between self sorts of 
each individual and every other individual 
(inter-individual, S-S), and (c) 7’s between 
ideal sort of each individual and every other 
individual (inter-individual, I-I). 

Each subject was required to do a self sort 
and an ideal sort on each of the 20 RSPC 
and on the UPC. Cards were sorted into nine 
piles, with categories ranging from “most like” 
to “most unlike.” For the self sort, the cate- 


1 Indebtedness is acknowledged to B. Buzzotta, J. 
Nolte, D. Petrovich, and R. Soskin, for their interest 
and sustained effort. Among the conditions required 
for a valid test of the hypothesis would be one of 
optimal maintenance of interest and attention to 
such a task. In Table 1, there is no relation between 
the order of their names and the order of the subjects. 
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gories at the extremes were “most like you” 
and “most unlike you”; for the ideal sort, 
“most like you want to be” and “most unlike 
you want to be.” 

It was postulated that the degrees of rele- 
vance or pertinence for any person for any 
frame of reference are normally distributed 
for the UPC. For nine categories of distinc- 
tion, the distribution of Proportions of the 
theoretical normal curve should be as fol- 
lows: .0401, 0655, .1210, .1747, .1974, 1747, 
1210, .0655, and .0401, Translating these 
Proportions for the UPC in terms of whole 
numbers, the 1575 statements should be 
sorted into the following groups: 63, 103, 
191, 275, 311, 275, 191, 103, and 63. The 
distribution used in this experiment conformed 
to these proportions. Since each RSPC was 
randomly drawn, the distribution of degrees 
of relevance for each is thereby considered 
normal. The distribution used in sorting each 
RSPC was therefore determined to be: Dy Sy 
6, 9, 10, 9, 6, 3, and 2 (1). 

The order in which the sorts were done was 
as follows: (a) all 20 self sorts on the RSPC, 
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(5) all 20 ideal sorts on the RSPC, (c) the 
self sort on the UPC, and (d) the ideal sort 
on the UPC. After completing the 20 sorts in 
the first series, it seemed almost certain that 
no one could remember the sorting of a par- 
ticular RSPC at the time of the second series. 
The subjects were certain they had no mem- 
ory of any particular previous sort. The im- 
portance of memory in an experiment such as 
this is unknown, but it would seem safe to 
say that any effect from memory would be of 
negligible significance. After completion of the 
20 ideal sorts, the two sorts on the UPC were 
done in the order stated. The execution of a Q 
sort constituted an assignment of weighted 
scores by the subject, ranging from nine a 
the “most like” to one at the “most unlike 
end of the categories. 

The data obtained from all of the sorts 
referred to in the preceding paragraph fur- 
nished the basis for the 336 intercorrelations 
in Table 1. At this point it may be well to 
clarify in detail what was involved in the cal- 
culation of a correlation coefficient, so that 
the reader may know what was correlated 


Table 1 


Q Sort r’s Obtained on 20 RSPC and the UPC on F 


our Subjects, Based on Intra-individual Comparisons 
(Self-ideal) and All Inter-individual Comparisons (Self-self and Ideal-ideal) 
Subject and Sort 

Random A-A B-B C-C D-D A-B A-C A-D B-C B-D C-D A-B A-C A-D B-C B-D C-D Random 
Set SEL Si. Ss. 56 55 eS SS Ss Ge EY m mr we ti Set 
o 18 5 ee ae mare S3 57 74 79 7i 6S 80 o0 
o1 a Ee i RSA Cas gg A S 5S 69 80 78 078 (74 ‘80 o1 
as Be a BA 81 66 S2 58 64 82 55S 82 7⁄1 ‘76 81 80 80 02 
D Gal or aes o a3 59 66 70 70 79 076 83 03 
o OMI as ey et S S $7 73 73 079 “80 ‘84 04 
og e a a ey, a Re -73 84A 77 077 079 87 o5 
i ete ep te as gy o -83 79 77 185 "79 ‘89 06 
of ena fee RTM rs a a A 85 Te 76 83 85 ‘gg or 
o8 Eaua “SE oS a ise gg OS 80.83 a gS “ga o 
09 Royo, lee 22 ss 28 lay d 9 Sr aba BE E Gd, 66) pi oF 
m ee e e a Of 81 80 86 (76 [77 ‘7g 10 
n pas at BS AT AA 60 i6 $8 66 55 73 (80 65 70 82 11 
a Soan ar i So las s ce o S 69 66 75 173 A 197 12 
is Sepia Gye OL Ss 3a a a | “SO SA an 160, cate nre E al 13 
P e sone 82 28 da 45 a epee 70 80 7686 14 
16 5 IR 80 69 58 69 -67 62 74 ait 67 .76 -70 .76 .79 15 
17 oY as 77 55 59 65 48 62 -72 67 72 76 -79 wt? 83 16 
18 ‘82 as 2 42 -47 64 Al 65 54 80 .77 84 64 81 wh 17 
19 77 i72 6 71 56 52 69 61 60 57 .74 78 79 73 71 83 18 

a g 3 -80 39 41 56 56 46 55 .70 69 82 61 57 .79 19 
Mean r 81007650 
SD, 06 08 io y o BL ss 


UPG Y Hor 71 


Note.—A, B, C and 
A's self-ideal sort. 


k 77 74 HA 
-09 -07 .08 -10 .05 .07 -07 -04 
s69 ass 7L 83 


- For example: A-A indicates 
S-I 


=E C 
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with what. The subjects are designated by 
letters A, B, C, and D, and the Q sorts by S 
(for self sort) and I (for ideal sort). The 
RSPC were numbered from 00 through 19. 
Consider Subject A’s self sort on RSPC 00. 
He sorted the 50 items into nine piles, which 
in effect meant he had given weights or 
“scores” ranging from one to nine to each 
item. When Subject B performed a self sort 
on RSPC 00, he did the same. Thus, each of 
the 50 items in RSPC were “scored” by the 
two subjects. These 50 pairs of numerical 
values provided the basis for the z of .73 
found at.the top of Column 5, under A-B, 
S-S. Again, when Subject A performed an 
ideal sort on RSPC, he “scored” the 50 items 
in that set a second time; the 50 pairs of 
numerical values yielded the 7 of .78 found 
at the top of the first column in Table 1, un- 
der the heading A-A, S-I. Each subject was 
compared with himself in terms of self sort 
vs. ideal sort on each of the 20 RSPC, result- 
ing in 80 7’s for the four subjects. Each sub- 
ject was also compared with each of the others 
in terms of their self sorts, on each of the 20 
RSPC, yielding 120 7’s in all. Finally, each 
subject was compared with each of the others 
in terms of their ideal sorts on each of the 20 
RS ishing another 120 7’s. 

api cone in Table 1, under A-A, 
S-I, are listed the 7’s obtained from Subject A 
on the 20 RSPC, reflecting the agreement be- 
tween his self concept and his ideal concept. 
The mean value and SD of the 20 r’s were 
calculated. The mean 7’s and SDs were also 
determined for subjects B, C, and D. The six 
possible intercomparisons for self sort and 
ideal sort were determined in the same man- 
ner. The 16 parameters were obtained from 
the self sorts and ideal sorts on the UPC. It 
was the purpose of this experiment to deter- 
mine the degree of agreement between the 
statistical values on the RSPC and the para- 
metric values on the UPC. 

As a null hypothesis, it would be stated 
that no difference exists between the mean 7's 
obtained on the RSPC and the r’s obtained 
on the UPC. 


Results 


From Table 1 it can be seen that nor one 
of the differences between the mean 7's ob- 


tained on the RSPC and the 7’s obtained on 
the UPC is statistically significant. Even at a 
10% level of confidence, the null hypothesis 
that no difference exists would not be rejected. 
The degree of agreement may also be ex- 
pressed in terms of the correlation between 
the mean RSPC 7’s and the UPC 7’s, r = .94. 


Discussion 


This study is offered as a methodological 
contribution: the establishment of a universe 
of statements drawn up in systematic and in- 
clusive fashion, as a supply from which state- 
ments may be drawn for use in Q-sort studies. 
It has been demonstrated that statistical 
values for the random samples are in close 
agreement with the parametric values for the 
universe. The agreement held between persons 
for self sorts, between persons for ideal sorts, 
and within persons for self-ideal sorts. The 
experimenter is thus in position to determine 
with greater confidence the stability of Q-sort 
correlations for a particular individual. One 
need not necessarily rely on results from only 
one set of statements. Results from one set 
may be compared with results from any other 
set of statements. Agreement between results 
on the independently drawn RSPC is a basis 
for verification. If it is desired to see whether 
or not change has occurred (for example, 
change in a patient in psychotherapy), the 
same or another RSPC may be used. The use 
of two or more RSPC yields independent sets 
of measures to determine agreement as to ex- 
tent and direction of change, if any. Thus, 
increased confidence may be felt that such 
changes as are reflected are meaningful in 
nature. 

With regard to possible overlap of items in 
the 20 RSPC and the UPC, no actual count 
was made. It seems reasonable to assume that 
at least 600 items in the UPC were not in-: 
cluded in any RSPC. 

It may be permissible to consider an anal- 
ogy in the field of physical measurement. If 
a random sample of adults were to be meas- 
ured for height and weight, the correlation 
between the values would agree, within the 
limits of experimental error, with the corre- 
lations on other random samples and with the 
correlation on the entire supply from which 
the random samples were drawn. In executing 
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two sorts, such as self and ideal, on a given 
RSPC, a subject would assign pairs of values 
to a set of randomly drawn statements. It 
should be expected that the values he would 
assign on random sets of statements would 
correspond with values he would assign on the 


universe from which the unbiased samples. 


were drawn. 
Summary 


Reliability of Q-sort correlations cannot be 
determined through alternate forms involving 
equated items. A new approach involves se- 
lecting groups of statements rather than 
matching items. A universe of 1575 Personal 
Concepts (UPC) was drawn, using every 
word in the dictionary suitable for formulat- 
ing human reaction at the sixth-grade level or 
below. Using random digits, Random Sets of 
Personal Concepts (RSPC) were drawn: 20 
sets of 50 items. A null hypothesis was pro- 
posed: self-ideal correlations on the 20 RSPC 
would not differ from the parametric values 


on the UPC. Four graduate students per- 
formed the experiment. The hypothesis was 
not rejected (10% level). It was concluded 
that results on random sets agree with results 
on a universe which is clearly defined, easily 


understood, and consistent in frame of ref- 
erence. 
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The Taylor Manifest Anxiety Scale (MAS) 
(18, 19) has figured prominently in many 
recent examinations of the phenomena of 
anxiety and learning. These studies gener- 
ally have yielded findings of significance and 
theoretical importance. Hence, the reliability 
and validity of the scale as a measure of mani- 
fest anxiety deserve examination. 

The reliability of several versions of the 
MAS, under various conditions, has ranged 
from .68 for anxiety scores from the complete 
Minnesota Multiphasic Personality Inventory 
(MMPI) and the Biographical Inventory 
(19) to .95 for the original 225-item form 
and a form consisting only of 50 critical items 
(14). A review of the literature (12) has re- 
ported a figure of .96 as the upper limit of 
this range. Most frequently, retest reliabilities 
are above .80, even after a lapse of seventeen 
months (10). Considering the diversity of 
forms marshalled under the aegis of the MAS 
with dissimilar buffer items (6, 9, 18, 19), 
changes in the number of critical items (9, 11, 
18, 19), substitutions in the use of particular 
critical. items (5, 21), and modifications of 
the vocabulary and sentence structure of the 
critical items (4, 19), these figures are re- 
assuring. 

However, the picture is not so conclusive 
when the aspect of validity is examined. When 
the MAS was first constructed it was not 
validated against a criterion of manifest anxi- 
ety external to the scale itself. Instead, items 
were selected on the basis of substantial agree- 
ment by five clinicians on 65 of 200 or so 
MMPI items (18). Later, 50 items showing 


1 Now at the Medical College of Virginia. 


51 


the greatest relationship to total anxiety 
scores became the node of the scale (17). 

As Taylor has recently pointed out, “The 
construction of the test was not aimed at de- 
veloping a clinically useful test which would 
diagnose anxiety, but rather was designed 
solely to select Ss differing in general drive 
level” (20, p. 303). Hence, many studies em- 
ploying the MAS have not investigated anxi- 
ety per se, but rather the effect of drive on 
performance. A tidal wave of MAS studies 
verifying hypotheses from Hullian theory has 
appeared. In all of these studies anxiety has 
been defined in a thoroughly operational man- 
ner, i.e., in terms of MAS scores only. Such a 
procedure is sound methodologically but lim- 
ited clinically. The need for validation against 
external ratings of anxiety has been assuaged 
with a spate of articles. 

It has seemed to the present writers that an 
ideal way of demonstrating the validity of the 
MAS largely has been overlooked. This 
method is identical with that for validating 
a projective test. It consists of measuring, 
manipulating, and remeasuring an independ- 
ent variable, in this case anxiety, to determine 
whether observed differences in the magnitude 
of the variable correlate with measured differ- 
ences in MAS scale scores. 

Only one study seems to have approached 
this technique. Gallagher (9) hypothesized 
that students undergoing client-centered ther- 
apy would show a significant decrease in 
anxiety upon the termination of therapy. He 
used four measures of anxiety derived from 
the MMPI, including the MAS. All the meas- 
ures showed a significant decréase from before 
therapy to after. He mdde a point of distin- 
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guishing between anxiety used as a theoretical 
motivating factor, “present by inference rather 
than by direct observation,” and anxiety stress 
which is “a descriptive term for a syndrome 
of physiological and psychological tensions” 
(9, p. 443). 

Although Gallagher was concerned with 
anxiety stress, the measure he found most 
adequate, the MAS, has been used to demar- 
cate both types of anxiety. Hence, the present 
investigators would have appreciated some in- 
dication of physiological and psychological 
tension in the subjects of his study other than 
that obtained by MMPI items and the fact 
that the college students presented themselves 
for help in personal adjustment. What seems 
to be missing, from the point of view of a 
validity study, is the direct observation of 
anxiety stress. 

It seems germane to study anxiety in a 
more stressful situation than college life, in a 
situation where the alleviation of anxiety 
would be a major factor and not a “subgoal” 
(9, P. 444) of therapy. The present investi- 
gation used as subjects persons in a life situa- 


tion exposing them to severe loss, if not to 
danger or injury. 


Problem 


The purpose of the present study was an 
attempt to validate the MAS directly by ap- 
plying it to anxious subjects in a stress situa- 
tion. The anxiety of these subjects was then 


eat manipulated in that certain of 
them underwent carbon dioxide thera 
(CO,) to allevi s 


ate their anxiety, while others 
were not treated therapeutically. It was hy- 
pothesized that as those persons receiving 
CO, had their directly observable anxiety 


(Gallagher’s anxiety stress) reduced there 
would be a concomitant reduction in MAS 
score. Subjects not r 


eceiving CO, would not 
undergo any reduction in MAS score. 


Method 
Subjects 


All Ss were selected from a penitentiary 
with virtually all kinds of inmates whose sen- 
tences ranged from a comparatively short pe- 
riod to life imprisonment. Inmates appearing 


in the daily referral to the prison psychiatrist 
were screened for suitability. 


Only persons psychiatrically diagnosed as suffering 
from an emotional disorder with predominant symp- 
toms of manifest anxiety were eligible to become Ss. 
The Ss selected were directly observed to be more 
than normally apprehensive. They presented a wide 
range of anxiety symptoms. Chief among these were: 
free-floating anxiety, periodic anxicty attacks, poor 
concentration, frightening dreams, sleeplessness, ano- 
rexia nervosa, fearfulness, irritability, general rest- 
lessness, and tension headaches. One S, who suffered 
from tension headaches and whose MAS score was 
comparatively low, asked an examiner to inspect his 
responses and tell him if they were those of a nor- 
mal man. Other Ss presented a more labile picture. 
Several Ss feared attacks of panic. One indicated this 
fear by saying, “I feel like my nerves are about tO 
overtake me.” Another S$ requested treatment because 
he was in constant dread of being attacked by other 
prisoners. Although this man was well liked, his fears 
were aggravated by a murder which occurred in the 
prison. One S was lost to the study because of an 
anxiety attack while Participating in the investiga- 
tion. While walking down a corridor smoking ® 
cigarette he was seen by a guard. To call the prison- 
er’s attention to his infraction of a rule, the guar 
called out, “Hey you!” The prisoner began shaking» 
went into a severe anxiety attack, and immediately 
had to be hospitalized. In addition to such symP- 
tomatology, in nearly all cases the inmates’ prison, 
social, or work adjustment was seriously impaire¢ 
as a result of their anxiety. 


The Ss were not, then, given the MAS and 
demarcated as anxious on the basis of their 
test scores. Instead, they were prison inmates 
whose anxiety already was diagnosed psychi- 
atrically as sufficiently serious to warrant 
therapeutic intervention. Twenty-four highly 
selected inmates were divided into treatment 
and control groups. There were 8 white 5S 
and 4 Negroes in the control group and 
whites and 5 Negroes in the experimental 
group. The Ss were randomly assigned to 
either the experimental or control group n 
nearly all cases. It was not practicable, for 
example, to assign a potentially violent Pa 
tient to the control group. Every effort was 
made to avoid assigning patients to the con- 
trol group merely on the basis of a less press” 
ing need for treatment. 

The groups were closely matched with re- 
gard to length of institutionalization, age 
and IQ. Statistically, the means for the tw 


samples arose by sampling from the same 
population. 
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Procedure 


A pretest interview was conducted with 
each S before testing to assess the S’s reaction 
to the test situation with particular attention 
to their test anxiety. Ss who reacted in a hos- 
tile or suspicious manner were eliminated from 
the present investigation. The Ss receiving 
CO, were tested within the week prior to the 
beginning of treatment and received their 
second testing session within the week after 
treatment was concluded. The time between 
the testings of the control group was identical. 

Both groups continued to participate fully 
in institutional living. Nothing was done to 
alter directly the stressful environment of 
either group. CO, was administered in a 
matter of minutes and the inmate was re- 
turned to face the stresses of prison life. Thus, 
the sociopsychological effects of treatment 
Were minimized. 


Psychological Tests 


The pre- and posttherapy tests consisted of 
the critical items of the MAS, as listed by 
Windle (21) with the exception of MMPI 
item 442, and the Bender-Gestalt test (B-G) 
(2). Because of suggestions that the MAS 
may be “especially susceptible to subject’s 
Conscious or unconscious motivation to pre- 
sent a favorable picture of themselves (6, 
p. 277), another measure, less susceptible to 
faking seemed desirable. A posttherapy de- 
crease in MAS scores should reflect a more 
efficient approach to reality. Pascal and Sut- 
tell (16) claimed that the B-G test is a bit of 
reality with which S has to cope. The result- 
ing performance, therefore, may be a measure 
of “an attitude toward reality” (16, p. 8). 
Basowitz et al. (1), supported this contention. 
They found that normal, anxiety-prone Ss in 
a stress situation, i.e., paratrooper training, 
gave less efficient performances to tachisto- 
scopically presented B-G designs than did a 
control group. Since it is claimed that “simu- 
lation is impossible” (2, p. 152) on the B-G, 
it seemed an ideal companion, especially when 
objectively scored, for the “susceptible” MAS. 


Carbon Dioxide 


Carbon dioxide seems to be an especially 
effective somatic therapy in the treatment of 


anxiety (3, 13, 15). The present investigation 
employed Meduna’s (15) slow coma tech- 
nique, with a mixture of 30% CO, and 70% 
O,. At no time was pure CO, ever introduced 
into the breathing bag. The number of treat- 
ments received by the experimental group 
ranged from 14 to 22 with a mean of 19.2. 
Treatments were discontinued upon manifest 
amelioration of anxiety, i.e., the Ss presenting 
complaints were no longer directly observable 
and psychiatric diagnosis indicated that ther- 
apy could be discontinued. The control group 
received no treatment. 

In his review of the literature on CO,, 
Frank (8) expounded two methods of control 
in CO, experiments: (a) an untreated control 
group and (b) a treated control group to 
be given either an N,O-O, mixture or O, 
“spiked” with CO,. The second suggestion is 
neither as logical nor as simple as it first ap- 
pears; for CO, is more frequently reacted to 
as a noxious stimulus than is N.O. A “pla- 
cebo” of N,O could be easily distinguished 
from a treatment of CO,. Spiking with CO, 
may also be unsound, for the central nervous 
system is highly selective in its takeup of CO,. 
Consequently, a much higher concentration of 
CO, may exist in the blood than the small 
amount used to spike the gas would suggest. 
Such a concentration could not be regarded 
as a placebo. 

Because of such considerations, the control 
group was untreated but continued to live in 
the same stressful environment as the treat- 


ment group. 


Statistical Treatment 


The data of the present experiment, com- 
ing as they did from a sample selected for 
symptoms of manifest anxiety, could be ex- 
pected to be markedly skewed. The scoring 
of the B-G also distributed in a moderately 
skewed manner in the population on which 
the test was standardized (16). Hence, Fes- 
tinger’s (7) distribution-free method of anal- 
ysis was employed. 


Results and Discussion 


Median scores for the experimental and 
control groups of the MAS and the B-G are 
shown in Table 1. The Festinger (7) rank 
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Table 1 


Median Scores of Experimental and Control 
Groups on the MAS and the B-G 


Experimental Group Control Group 


Test Pretest Posttest Pretest Posttest 
MAS 28.5 19.0 22.0 22.5 
B-G 30.5 22.0 20.5 33.0 


difference comparisons of the two groups are 
listed in Table 2. 

As can be seen from Table 1 , both the MAS 
and B-G scores for the experimental group de- 
creased following CO,. MAS values for the 
control group remained approximately the 
same, suggesting the environment they orig- 
inally found to be stressful had remained 
relatively unchanged. The B-G scores of this 
group, however, markedly increased. This dif- 
ference in scores is interesting, but because of 
the limited number of Ss the present writers 
will not indulge in public post hoc speculation. 

Table 2 reveals that the MAS scores de- 
creased in a statistically significant manner 
for the group whose anxiety was treated by 
CO,. There was no such decrease for the un- 
treated anxious group. These people, pre- 
sumably, continued to operate in a stressful 
milieu. The hypothesized reduction in MAS 
score was realized, 

The MAS may be said to reflect differences 
in the magnitude of the variable of manifest 
anxiety. Hence, it was found to be a valid 
measure of manifest anxiety. 

It should be remembered that the B-G test 
was included to check any tendency on the 


Table 2 


Festinger Comparisons of Experimental and Control 
Groups on the MAS and the B-G 


Mean Rank 
pee 
Experi- 
mental Control 
Test Group Group d 
MAS 9.08 15.92 3.42* 
B-G 9.42 15.58 3.08" 


* Significant at the .05 level, 


part of the experimental group to fake MAS 
responses. The improvement of the treatment 
group was significant also in their B-G scores. 
As MAS scores decreased B-G performance 
improved. This improvement in coping with 
the reality of the B-G test suggested that the 
MAS was not faked by the experimental 
group. 

An association implicit in the present study 
is that the observation of manifest anxiety has 
a relationship to MAS scores, Several studies 
specifically relating MAS scores and observa- 
tional data have appeared. In none of these 
studies has the relationship between observed 
anxiety, observed diminution of anxiety, and 
MAS scores been investigated. Certainly E 
high relevance of this relationship, quantifie 
and made explicit, earmarks it as a desidera- 
tum for future research. 


Summary 


Distribution-free comparisons of a group of 
24 manifestly anxious prisoners were made. 
Half of the men received CO, and half pa 
given no treatment. Reasons for the govern 
of a placebo control were advanced. A stati i 
tically significant improvement in the por 
formance of the experimental group on t a 
MAS was obtained. This improvement P 
also seen in a check test, the B-G. The resu 
were interpreted as indicating the validity ° 


ifest 
the Taylor MAS as a measure of manifes 
anxiety. 
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Bender-Gestalt Test Correlates of 
Emotional Depression’ 


John E. Tucker and Mimi J. Spielberg 


Mental Hygiene Clinic, VA Hospital, Albany, N. Y 


The purpose of this study was to discrimi- 
nate between depressed and nondepressed 
clinical patients by means of the Bender- 
Gestalt given in diagnostic test batteries. 

Thirty-six male Ss were divided into two 
groups, depressed and nondepressed. The dif- 


ferences in age and intelligence between the 
two grou 


The sam 


psychological test 
Bender. Acceptable 
was demonstrated i 
two groups. A 27-item check list was devised 
for use as a guid 
depression. 

The Bender scor 
of Pascal and Sutt 
The identity of the 

Comparisons wer 
pressed and nonde 
Bender test item s 
lected for compar 
clinically. Of the 


ing system used was that 
ell, a 107-item check list. 
Patient was concealed, 
e made between the de- 
Pressed Ss on 20 separate 
Cores. Not all the items se- 
‘ison were equally relevant 
20, only two items, tremor 
1 An extended report of this study may be ob- 
tained without charge from John E. Tucker, Mental 
Hygiene Clinic, VA Hospital, Albany, N. Y., or for 
a fee from the American Documentation Institute. 


Order Document No, 5430, 


remitting $1.25 for micro- 
film or $1.25 for Photocopies. 


and distortion, were found to be significant at 
the .05 level. No items were significant at the 
.01 level. ‘ 

It can be concluded that Ss sometimes a 
press depression through a tremor on t : 
Bender-Gestalt. Tremor alone is not or 
to diagnose depression, but it perhaps can, E 
used to warn a clinician of that possibility- 
Tremor was found primarily among the psy- 
choneurotic Ss. 

The greater distortion was found in the 
pressed group, and the Ss who distorted N 
designs were primarily psychoneurotics. 
distortion was found in the nondepece 7 
group. This finding seems to contradict 
hypothesis of pedantic accuracy usually hg 
ciated with depressed behavior. Since this E 
sult does not appear to be clinically mean ga 
ful, it may be an artifact of the sample. Ot a 
items usually thought to be related to ine 
sion, such as compression of drawing spari 
were nondiscriminating. The Bender test, z 
scored by Pascal’s system, does not seem 
offer clinical usefulness in detecting emotionā 
depression in typical cases in our clinic. at 

Comparisons were made of average initi 4 
reaction time and average total response ei 
to each card. It is interesting to note that th 
tendencies were not in the expected direction. 
The nondepressed Ss were slower in te 
Bender response times than the depressed p 
tients. 


Brief Report. 
Received October 25, 1957. 
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Assaultiveness and Two Types of Rorschach 
Color Responses’ 


Robert Sommer and Dorothy Twente Sommer 
The Saskatchewan Hospital, Weyburn 


ch Much of the thinking about the relation- 
hip between Rorschach responses and other 
behaviors is based on the concept that the 
formal aspects of the responses (determi- 
nants) should have correlates in other be- 
haviors of the person (introversion, anxiety, 
ete.). However, present-day thinking tends to 
regard information as to structural aspects of 
Personality alone (e.g., defense mechanisms) 
as insufficient for understanding the behavior 
Of the individual. Past thinking was consid- 
ered unsatisfactory in that it looked for rela- 
tionships between energy, affects, or need and 
Overt behavior without taking into account the 
channels the organism had developed for han- 
dling this energy. It was also felt that infor- 
Mation as to these structures alone left one 
With a bare shell and still unable to predict 
the actual behavior of the person. What was 
Needed was information regarding both the 
Contents of fantasy and the person’s tech- 
niques for handling his affects. 

‘At least two approaches to Rorschach re- 
search are unsatisfactory: (a) to relate de- 
terminant scores to behavior without regard 
to the content of the responses; * (b) to re- 
late content categories (e.g., destructive, oral 
expulsive, etc.) to behavior without regard to 


1The study was supported by a grant from the 
State of Louisiana hospital research fund. Without 
the active cooperation of the staffs of Gulfport VA 
Hospital (especially Herdis A. Deabler) and of South- 
east Louisiana Hospital (especially Joseph G. Daw- 
son), the study could not have been undertaken. — 

2 With some determinants there is @ confounding 
of content and structure, as in M where the use of a 
human figure is usually required. Since this is a com- 
mon but not necessary condition for M, it makes the 
Meaning of any correlation between M and other 


factors quite ambiguous. 


57 


the formal aspects of the response (determi- 
nant score). $ 

An attempt is made in the present study to 
base predictions on a combination of formal 
and content elements. The type of behavior 
selected for study is assaultive or explosive 
behavior where the Rorschach literature is 
both considerable (3, 4, 6, 7) and often con- 
tradictory. There have been several attempts 
to design experiments that would assess the 
merits of the hypotheses proposed, but the re- 
sults are not easy to understand. With regard 
to structural correlates of explosive behavior, 
there are those who believe that either very 
many color responses or no color responses are 
indicative of it. With regard to the content of 
the responses, predictions can be both very 
specific (“tomahawk” to the white space on 
Card VII indicates aggressive acting out) or 
very general (many animal responses indi- 
cates stereotyped thinking). In the prediction 
of aggressive behavior from the Rorschach, 
there are two distinct groups of clinicians: 
(a) Some believe aggressive contents indicate 
that the person is able to express his hostile 
impulses in a socially acceptable way and 
hence has no need to act out. Phillips and 
Smith (5), for example, speak of blood re- 
sponses as contraindicative of destructive act- 
ing out. (b) Others believe that the use of 
hostile content indicates a preoccupation with 
such thoughts. Depending upon the individu- 
al’s impulse-control system, such behavior 
should be expected if the sample of the in- 
dividual’s life-history is adequate. Few tests 
have been based on the first approach except 
that of Stone (7) which met with essentially 
negative results. Those of Pitluck (6) and 
Finney (1) may be taken to support the lat- 
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ter view, although in the former case the re- 
sults were not clear-cut. : 

The present problem is to determine the 
relationship between explosive behavior and 
two types of Rorschach color responses: (a) 
aggressive and explosive responses (volcano, 
fire, blood from a wound, etc.); (b) nonag- 
gressive responses (bouquet, ice-cream, orchid, 
etc.). One essential condition is that the two 
groups should not differ in Sum C; the only 
difference should be in the content of the color 
responses. Our prediction, based on the work 
of Stone, Pitluck, and Finney, is that the “ 
gressive content” group will show more 
plosive and assaultive behavior than the “non- 
aggressive content” group. It was also decided 
to distinguish between physical e 
and assaultiveness (defined as exp 
cal attacks on persons, objects, o 
the environment) and verbal expl 
assaultiveness (explosive episodes where tor- 
rents of abuse are directed toward the outside 
world). Both definitions stipulate that the be- 
haviors be characterized by an explosive qual- 
ity in addition to being assaults upon the en- 

vironment. 

An ancillary hypothesis was that “ 
sive movement responses” 
ing, etc.) , when accompan 
responses, would improve 
gressive acting-out beha 
chief emphasis of the study was on the dif- 
ferences in behavior between Ss who gave 

aggressive color responses” and those who 
gave “nonaggressive color responses,” 


ag- 


ex- 


xplosiveness 
losive physi- 
r animals in 
osiveness and 


aggres- 
(e.g., fighting, kick- 
ying aggressive color 
the prediction of ag- 
vior. However, the 


Procedure 


Our preference for c 
was for meaningful ac 


ay not have been inter- 
that one is studying. If 
S of considerable impor- 
al’s relations with others, 
assaultive behavior, the 
nterviewer’s overlooking it are 


the behavior studied i 
tance in the individu 
as is the case with 
chances of the i 


minimal, although the possibility must still 
be considered. s 
Hence, our criteria of assaultiveness are in- 
cidents of such behavior in case histories 
gathered routinely by the social service de- 
partment of a VA hospital. The procedure 
limited our sample to male psychiatric pa- 
tients which is regrettable in terms of gen- 
eralizing from the results but advantageous 
if aggressive acting-out is more prevalent in 
such a group. , 
Essentially, the method embodied an & 
post facto design in which two investigators 
worked independently. The senior anho 
spent several weeks going through the files a 
the psychology department of this oe 
and looked over approximately 200 aa 
(none of which he had seen before). He oe 
down the names of those patients vag di 
given explosive color responses (objectively 
defined as responses of volcanoes, explosions, 
fire, etc.) and those who had given exclusively 
nonaggressive color responses (orchids, gon 
quets, sherbert, etc.) and also whether or no 
the M responses could be classified as aggres i 
sive or not (objectively defined as actions 0 
fighting, kicking, etc. in a way similar to p 
ney’s category of “active destruction” in e 
Palo Alto scale). If a person with aggressiv 
color responses also had several ae 
sive color responses, he was still included A 
the aggressive color category, If a subject ie 
even six or seven nonaggressive color a ee 
and one that was Partially aggressive, he Wa 
not included in the nonaggressive color group: 
The list of approximately 65 names, an 
ranged in alphabetical order and with all oue 
information removed, was given to the en 
investigator who was instructed to inspect th 
case history of the patient and rate the pre- 
hospital behavior along a seven-point scale SA 
(a) physical assaultiveness and (b) verba 
assaultiveness. If there was insufficient infor- 
mation for rating along a dimension, a zero 
could be used. Some attrition was expected in 
our sample as a few case histories had been 


sent to other installations or could not other- 
wise be located. 


Results 


The final data consisted of the ratings of 
the case histories of 26 aggressive color SS 


N 
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Table 1 


Ratings on Explosiveness and Assaultiveness 


Measure and Group N” 


A. Physical explosiveness 


Aggressive color Ss 22 
Nonaggressive color Ss 26 
B. Verbal explosiveness 
Aggressive color Ss 23 
Nonaggressive color Ss 28 
C. Physical and verbal explosiveness 
Aggressive color Ss 22 
25 


Nonaggressive color Ss 


Mean S t b 
258 T] 1.69 05 
307 sc wt Be 
moo bs S 05 


^ The case histories of some Ss did not contain sufficient 


information for rating along all dimensions, Hence, the figures in 


the'ce fe i i i 
aelcells may vary slightly depending on the dimension compared. 


and 31 nonaggressive color Ss. The ratings on 
both physical and verbal assaultiveness ranged 
Over the full scale (from 1, very low, to 7, 
very high). The mean rating of physical as- 
saultiveness for the total population was 2.98 
While for verbal assaultiveness it was 3.39. 
The mean Sum C for the aggressive color 
group was 3.83, while for the nonaggressive 
color group it was 3.60. Neither of these dif- 
ferences are significant. 

The data which test the hypothesis that ag- 
gressive color Ss exceed the nonaggressive 
color Ss in ratings on assaultiveness are pre- 
sented in Table 1. i 

For physical assaultiveness, the aggressive 
color Ss significantly exceed the nonaggres- 
sive color Ss. The results on verbal assaultive- 
ness are suggestive but fall slightly short of 
significance. If the ratings for the two types of 
assaultiveness are pooled to form a rating on 
general assaultiveness, the difference between 
the groups is significant at the .05 level. The 


Table 2 


Percentage of Cases Predicted 


Rorschach Rating 


ee 
Non- 
Assaultiveness Aggressive aggressive 
Rating Color Ss Color Ss 
Above median 59 a 
Below median 41 60 


biserial correlation between the type of color 
response given by the S and the pooled rat- 
ings of aggressiveness is 35 ($ < 01). 

Table 2 presents the percentage of correct 
and incorrect predictions when the assaultive- 
ness ratings are divided at the median. It 
shows that although the results are in the ex- 
pected direction, it would be hazardous to de- 
pend on this variable alone in making pre- 
dictions about the potentiality for assaultive 
behavior in individual cases. 

Some interesting results appear when the 
protocols are divided on the basis of Ss who 
gave aggressive, nonaggressive, and no move- 
ment responses. An overall rating of the move- 
ment responses had been made by the senior 
author at the time of classification of color 
responses. If there was doubt as to whether 
the tone was aggressive or nonaggressive, the 
cases were placed in a separate category and 
not included in the comparisons in Table 3. 

Although the number of cases is necessarily 
smaller than in the preceding table, the dif- 
ferences are even more marked when based 
on type of C response and type of M response. 
In terms of the predictive value of a combina- 
tion of movements to color responses, the 
biserial y for a comparison of the “aggressive 
color and aggressive or no movement Ss” with 
the “nonaggressive color and nonaggressive or 
no movement Ss” for their hostility ratings is 
55 (p < .01). There are not enough cases 
where aggressive color Ss gave clearly aggres- 
sive M responses to use either of these cate- 
gories in the comparisons. « 
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Table 3 
Ratings on Explosiveness and Assaultiveness with Ss Classified by Type of C and M Responses 


Measure and Group 


A. Physical explosiveness 
Aggressive C + Aggressive Af , 
Nonaggressive C + Nonaggressive M 


Aggressive C with no M 
Nonaggressive C + Nonaggressive M 


Aggressive C + Aggressive M 
Nonaggressive C with no M 


Aggressive C with no M 
Nonaggressive C with no M 


B. Verbal explosiveness 
Aggressive C + Aggressive M 
Nonaggressive C + Nonaggressive M 


Aggressive C with no M 
Nonaggressive C with Nonaggressive M 


Aggressive C + Aggressive Af 
Nonaggressive C with no M 


Aggressive C with no M 
Nonaggressive C with no M 


N Mean g $p 

8 4.00 ýs 
12 2.67 180 i 

6 4.00 NE: 
12 2.67 tas 

8 4.00 ‘a 
8 1.75 mid 

6 4, 05 
8 1.75 eo 

8 4.13 ae 
13 3.31 146 i 

6 4.17 e, 
13 3.31 280 N 

8 4.13 - o 
9 2.22 pet 

6 4.17 = 

eu 1.99 05 


Although the two groups of Ss had approxi- 
mately the same Sum C and M totals, the 
Sum C of the aggressive color Ss contained 
more pure C responses than that of the non- 
aggressive color group, which in turn ex- 
ceeded the former group in number of FC 
responses. The CF responses were approxi- 
mately the same for the two groups. This re- 
sult was hardly unexpected as most of the ag- 
gressive color responses could be scored C or 
CF, while “flowers” or “grasshoppers” gener- 
ally rate scores of FC or at most, CF. It 
seemed in order to see if a division by deter- 
minant alone (FC versus CF +C) would 
prove to be of more predictive utility with 
the ratings on assaultiveness than the use of 
content regardless of form-color balance. Fin- 
ney found that his groups of aggressive and 
nonaggressive Ss differed with regard to their 
CF + C:FC ratios, 

Of our sample, 39 Ss had CF + C exceed- 
ing FC, while 11 had FC equalling or greater 
than CF + C. Analysis of these data showed 
that there was not a significant difference be- 


tween the two groups on either physical oF 
verbal assaultiveness. 


Discussion 


There were two theories about aggressive 
Rorschach color responses outlined at the be 
ginning of this paper. The first was that suc 
responses constituted a draining off of hostile 
impulses and we should find less acting-out i” 
such Ss. This would postulate a concept of 2 
level of unreality where the person can solve 
his problems without fear of retribution from 
a hostile environment. If he is able to do this, 
he will have no need to act-out in a socially 
unacceptable fashion. There is an implicit a5- 
sumption here of a specific amount of psychic 
energy that the person can release either on 4 
fantasy level or on a behavioral level or 0? 
both. 
Two groups of empirical studies support 
this view. The first would be instances where 
tension released in overt behavior reduces the 
tension in the fantasy level. A case in point 
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would be the Zeigarnik effect experiments 
where the act of completing certain tasks will 
reduce the psychic tension as measured by 
memorial effects. There are also the studies 
Carried out at Clark University where physi- 
cal restraint increased the number of M re- 
Sponses given on the Rorschach. 

Conversely, there are those who believe that 
the use of a content area indicates a concern 
_ oF even preoccupation with a given topic. 
Hence, we should certainly expect behavioral 
Correlates if we look hard enough. This view 
implies that the Rorschach gives a sample of 
behavior in a particular situation (involving 
< an interpersonal relationship, a cognitive task, 

and a subjective experience on the patient’s 

Part of being evaluated). We should logically 

€xpect to find other behavioral correlates of 

Rorschach behavior. Loose or uncontrolled 

tesponses to (hypothesized) affect-arousing 

Stimuli should parallel analogous behaviors 

in similar situations. The patient who “ex- 

Plodes” during the Rorschach (or phrased less 

Strongly, the patient who loses the ability to 

Control his response to color) would be the 

Person we might expect to “explode” in other 

Situations. b 
A Our results support this second view. Ag- 

gressive responses on the Rorschach are not 
hegatively corrected with aggressive acting- 
out, they tend to be positively correlated with 
it. This has implications both for making pre- 
dictions of such behavior from the Rorshach 
and for our understanding of the relationship 

etween fantasy ° and behavior. The “cathar- 
sis” view of test responses is not uncommon 
among clinicians, especially in the matter of 
blatant sex responses. The idea is often pro- 
Posed that the person who reports several 
Penises and vaginas will be a mature person 
who is capable of expressing his impulses in 
an appropriate manner and hence less likely 
to indulge in antisocial sexual behavior. Our 
hypothesis would be that this is an incorrect 
Supposition. Research should show that indi- 
Viduals committing rape or indulging in self- 
destructive promiscuous behaviors will pro- 
duce significantly more blatant sex responses 


5 “Fantasy” as used here refers to an unknowable 
Construct, literally “the person’s inner world,” the 
Sontents of which can only be inferred from verbali- 

tions, parapraxes, etc. 


A TE, 


than patients hospitalized for other reasons. 
The hypothesis should hold even for veiled or 
suggestive test responses. One can recall the 
Levine, Chein, and Murphy (2) study in 
which responses of objects instrumental in 
eating (in addition to actual food responses) 
increased with food deprivation. Our hypothe- 
sis would be that except for rare instances, 
such as the autism of the schizophrenic, can 
fantasy serve as a contraindication of analo- 
gous overt behavior. Even the schizophrenic 
girl preoccupied with sexual fantasies will dis- 
play seductive and exhibitionistic behaviors 
on many occasions. It is our view that evi- 
dence for the “catharsis theory of test re- 
sponses” is based largely on inadequate sam- 
ples of the person’s behavior. It may be true 
that the girl with very strong sex fantasies 
will act prim and prudish when we interview 
her. Yet examine her behavior over the past 
year, or five years, or when she “let herself” 
have a few drinks, then we will find marked 
resemblances between fantasy life and other 
behaviors. Fortunately, in using case histories, 
we were able to view a sizable portion of the 
individual’s life. In studies involving artificial 
stimulus situations or small isolated samples 
of behavior, we should not expect to find high 
correlations between fantasy contents and be- 
havior. 


Summary 


The present study aimed at assessing the 
relationship between assaultive behavior and 
two types of color responses, aggressive and 
nonaggressive. The prediction was made that 
Ss giving aggressive color responses should 
show more assaultive behavior than the non- 
aggressive color Ss. 

One investigator looked through approxi- 
mately 200 Rorschach protocols of male pa- 
tients in a VA hospital and listed the names 
of Ss giving aggressive color responses and 
those giving nonaggressive color responses. 
The second investigator was given the list 
(without any information as to the category 
of the S) and was asked to rate the case his- 
tory of the S as to incidents of verbal and 
physical assaultiveness. The hypothesis was 
confirmed. The trends were especially clear in 
cases where S had given both aggressive color 
and aggressive movement responses. 
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Although the results were of theoretical 
relevance in assessing the relationship be- 
tween fantasy and overt behavior, the correla- 
tions were not of sufficient magnitude to per- 
mit their use in individual prediction of as- 
saultive behavior. 
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A Normative Note on Sentence Completion 
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Cross-Sex Identification Responses 
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The interpretation of projective responses 
may depend heavily for years upon such real, 
if elusive, factors as clinical experience and 
judgment. Quantitative data, however, can 
make more explicit and more communicable 
some aspects of clinical experience; further- 
more, it can correct individual bias in inter- 
pretation. : 

Normative data establish a more objective 
frame of reference and should serve in some 
instances to taper the more extravagant 1n- 
ferences. The meaning of cross-Sex identifica- 
tion responses is a case in point. Eron (1) has 
reported that 30.7% of the nonhospitalized 
males in his normative TAT study immedi- 
ately misidentified the sex of the figure in 
Card 3BM; an additional 29.4% evidenced 
uncertainty as to the figure’s sex, with a 
subsequent -18.7% misidentifying and 10.7% 
correctly identifying. On the other hand, 
Mainord (3) found that 94.79% of her male 
figure-drawing study drew the 
self-sex (male figure) first. With these nor- 
mative differences, it would seem that the 
clinician who makes comparable interpreta- 
tions from such cross-sex identifications does 
so at his peril. 

In view of the near absence of normative 
data on sentence completion responses, the 
writer undertook the following investigation. 


_A sentence completion form was administered 


to an incoming freshman class prior to the 
beginning of classes. Using a sample of 212 
male students, who subsequently took the 
elementary psychology course, the writer 
analyzed the results of sentence stems that 
yielded data on identification. The following 
three items produced cross-se* identification 
responses. 


. When he found the trunk with all the clothes 
in it, just for fun he dressed up as —— 

. In the college play he took the part of —— 

. He hoped that some day he would be just 
like —— 

The results in Table 1 indicate that cross- 
sex identification responses are to some extent 
a function of the stimulus properties of the 
sentence stems, or, if one prefers, a function 
of the differing levels of personality tapped 
by such stems. Thus, Item 43, a rather “ob- 
vious” item, produces cross-sex identifications 
in only 1% of the population studied; in 
most cases it evokes a variety of fairly “pub- 
lic” expressions of ego ideal or desires readily 
accessible to awareness. Item 23, in contrast, 
produces a rather large number (20%) of 
cross-sex identifications, as well as some prim- 
itive and regressive responses revealing iden- 
tification with animals and children. Different 
sentence stems evoke responses from differing 
levels of personality organization; this clinical 
observation is borne out by the research of 
Hanfmann and Getzels (2). The whole area 
is one which should be explored systematically 
and thoroughly if the greatest usefulness is 
to be derived from this easily administered 
and productive technique. Of the 43 subjects 
who responded with feminine identifications 
on Item 23, only three gave female responses 
to Item 39 and only one to Item 43; an addi- 
tional five gave “residual” responses in Item 
39, This residual category contains a miscel- 
lany of responses that are nonspecific with 
respect to sex; some of these certainly reflect 
other than healthy processes, e.g., “death,” 
“a nobody,” “dope.” No subject responded 
with feminine identifications in both Item 39 
and Item 43. It might be mentioned in pass- 
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Table 1 


mary of Responses by Categories in Sentence 
enea Producing Cross-Sex Identifications 
(N = 212 college males) 


Identification Response N % 
Item 23 
Male identification 143 467 
Female identification 43 20 
Animal identification 4 p 
Child identification 2 i 
Residual miscellaneous responses 20 9 
Item 39 
Male identification 177 83 
Female identification 6 3 
Animal identification 4 2 
Child identification 1 0.5 
Residual miscellaneous responses 24 11 
Item 43 


Father identification 


112 53 
Female identification 2 1 
Identification with other male relative 20 9 
Identifiable male figure (real or fictional) 16 8 
Ideal or hero 11 5 
Occupational responses 9 4 
Residual male figure 27 13 
Responses emphasizing individual 
uniqueness 8 4 
esidual miscellaneous responses ii 3 


ing that two subjects replied with animal 
identifications in both Items 39 and 43, 

In addition to evoking responses which lend 
themselves to classification with some ease 
(especially Items 23 and 39), these stems 
produce idiosyncratic responses which are 
clinically rich and serve well as bases for hy- 
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potheses concerning the individual’s personal- 
ity organization with reference to unconscious 
needs, ego ideal, fantasied self-image, and the 
like. The wide variety of individual replies to 
such sentence stems insures that the intuitive 
and imaginative clinician will have ample op- 
portunity to exercise his skills and also makes 
it obvious that the classificatory tone of this 
note cannot be suggestive of a substitute 
method of analysis. 

The problem of making valid interpreta- 
tions of an individual’s responses to projective 
techniques will never be resolved by a com- 
pletely normative approach. Those who prize 
the clinical mystery need not fear that such 
techniques will be reduced to a clerical op- 
eration. However, the results presented here 
should serve to caution the interpreter to take 
due cognizance of the variability in projective 
content evoked by different stimulus materials 
—in this case different sentence stems. Fur- 
thermore, here are provided some beginning 
normative data on three clinically useful 
items. gi 
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Some Determinants of the Perception of Hostility 


Bernard I. Murstein* 


University of Texas, 


The relationship between the responses ob- 
tained through the use of projective tech- 
niques such as the Rorschach and the overt 
behavior of persons has been one of the per- 
sistent problems confronting the clinical psy- 
chologist. Gluck, in studies with the TAT and 
Rorschach (3, 4), found no correlation be- 
tween overt hostile behavior and overt and 
Covert signs of hostility on the Rorschach and 
TAT. Cattell (1) has stated a theory hold- 
ing for a proportionality of overt and covert 
Personality deviation. Murstein (5), defining 
Projection as “the asggibing of one’s own Mo- 
tivations, feelings and behavior to other per- 
sons” referred to five variables which he con- 
sidered to be functions of projection: (a) the 
objective characteristics of the person, (0) 
the self-concept, (c) the amenability of the 
trait investigated to measurement, (d) the 
conditions under which projection is meas- 
ured, and (e) the instrument used to measure 
projection. 

Findings related to each of these variables 
have also been reported. All of them were of 
some significance in either of two conditions 
(Rorschach, ego threat) investigated. Gluck’s 
failure to find any relationship between the 
Rorschach and overt behavior may well have 
been a function of the failure to take cog- 
nizance of the above variables. 

Granted that these variables are important 
in the prediction of the operation of the 
mechanism of projection, the question arises 
as to whether there are any significant rela- 
tionships between the tendency to project 
hostility on the Rorschach and the tendency 
to perceive hostility as the result of an ego- 
threatening situation. The procedure for in- 


vestigating this question follows. 


1 Now at Louisiana State University. 


M. D. Anderson Hospital and Tumor Institute 


Procedure 


The method of pooled ranks was used to 
obtain group and self judgments of hostility 
on 536 students from 23 fraternities and two 
dormitories at The University of Texas by 
means of cutting scores based on considera- 
tion of the standard error of measurement. 
The method has been discussed more fully 
elsewhere (5). Eighty men, divided equally 
among four experimental groups (hostile-in- 
sightful, hostile-noninsightful, friendly-insight- 
ful, and friendly noninsightful) were selected. 

Each S of every group was given a Ror- 
schach test without formal inquiry for deter- 
minants. Only the content, animation, and 
description of the perceptions was recorded, 
in a manner similar to that followed by Elizur 
in his Rorschach Content Test (2). The in- 
structions given to each S were: 


I am going to show you a series of cards which are 
in reality inkblots. These inkblots have been chosen 
because they resemble many things. I want you to 
look at each of these cards and to tell me the first 
three things that you see on them. Do not hesitate 
to tell me anything that you see. Try to give a full 
description of what you sce rather than stopping 
after you have given just the name. There are no 
right or wrong answers as this is not a test. There 
are no restrictions at all as far as what you see. It 
is entirely up to you. I will write down on this sheet 
of paper whatever you tell me that you see. Are 
there any questions? 


After all questions had been answered, the 
Rorschach cards were presented in the usual 
manner. At the conclusion of the administra- 
tion of the cards, the examiner, after carefully 
glancing over the S’s record, said, “Now I 
shall give you a brief interpretation of what 
you have seen.” 

Each experimental group.of 20 Ss was di- 
vided and each half matched according to the 
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means of group rankings and self-rankings 
and their respective variances. Within each 
group, one half received the interpretation 
“friendly,” while the other half received the 
interpretation “hostile.” Initially, in selecting 
the Ss, the experimental group to which each 
S belonged was of course known. The author 
detached the name from the group so that at 
the time of testing (five weeks later) all that 
was known of any S was whether he was to 
receive a “friendly” or a “hostile” interpreta- 
tion. The purpose of this procedure was to 
forestall the possibility of bias on the part of 


the author which might favor one group over 
another. 


The following points were stated in the 
“friendly” report: 


1. You cooperated very nicely in taking this test. 
You saw things readily because you were interested 


and really “put yourself” into it. 2. Your perceptions 
are very rich in creativit: 


y and imagination. 3. Your 
Perceptions reveal a lot of feeling for people, and a 
lot of warmth; you are a friendly, cooperative per- 
son. 4. Your perceptions indicate a deep sensitivity 
to the needs of others. 5, You are, therefore, psycho- 
logically speaking, a mature and fairly well-adjusted 
person. Do you have any questions? 


The following points were stressed in the 
“hostile” report: 


1. You showed 
test. Your Perceptions indic 


Poor in imagination and 
3. You are pretty “cold” 
operative, hostile person. 
e a lack of sensitivity to 


toward people and an unco 
4. Your perceptions indicat 
the needs of others, 5. You are, therefore, psycho- 
logically speaking, immature and not too well-ad- 
justed. Do you have any questions? 

The most frequent question was, “Where did you 
get that from?” In this Case, a response was chosen 
at random and the examiner merely stated again that 
this had either a “friendly” or “hostile” connotation 
(accordingly), at a deeper Psychological level, 


The examiner then 
Rating Sheet (hencefo 
to the S, saying, 


Presented the Examiner 
rth referred to as ERS) 


Now, I shall ask you to fll out anonymously a 
rating sheet whereby you evaluate me. This is a part 
of some research that the Psychology department is 
currently running. Do not put your name on this 
sheet. When you have finished the ratings, put the 
sheets in this envelope and seal it and drop it in 
this box. I shall return in about five minutes to see 


whether or not you are finished and ready to go on 
to the last part of the study. 


The ERS consisted of 19 statements taken 
from the larger Interview Rating Scale used 
by The University of Texas Testing and Guid- 
ance Bureau (7). A typical statement taken 
from this sheet was “The interviewer is a 
warm, sincere individual.” The S rated each 
statement on a five-point scale: five for 
“strongly agree,” four for “agree somewhat, 
three for “undecided,” two for “doubtful, 
and one for “strongly disagree.” The higher 
the score, the more favorably the S rated the 
interviewer. 

j The ERS was filled out and returned, and 
then the examiner explained that the report 
which he had given the S was used for PEA 
mental purposes and was not meaningful. T e 
random nature of selection of the “hostile = 
port was explained, and the fact that one per 
son out of two in the total group received p 
“hostile” report seemed to reassure most 0 
the Ss. None of the Ss seemed disturbed pi 
the experiment. Before leaving, the Ss pern 
asked not to mention any aspect of the e 
periment to anyone for four weeks, and wee 
also thanked for their participation. To oor 
ure the projection of hostility on nE “a 
schach, a new scale was devised calle “a 
Rorschach Hostility Scale (RHS). This m 
has a range of from one to seven e x 
any given response on the Rorschach. P 
essentially a two dimensional scale, one ite 
mension being an overt-covert one, while ia 
other is a lower-phyla-higher-phyla range. E 
other words, a mangled human would F 
scored higher with regard to hostility m 
mangled insect. This scale has been sho a 
to be quite reliable when scored by a J 

scorers, with an average reliability of .96 ( i a 
The RHS was used to measure the hosti i 
content of the Rorschach protocols of a 

80 Ss. 


Results 


In order to test the relationship between the 
RHS scores and the ERS scores, it was first 
necessary to transform the raw scores into 
standard scores. By comparing the two sets of 
scores in relation to the variables group judg- 
ments of person (“hostile” or “friendly”), 
self-concept (‘“hostile” or “friendly”), and 
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kind of interpretation received (“hostile” or 
friendly”), 27 possible combinations were 
arrived at, which are indicated in Table 1. 
Since the RHS distribution was quite 
skewed as compared to a normal distribution, 
when tested by the chi-square distribution 
(p < .01), a Pearson correlation between the 
two sets of scores (ERS and RHS) was not 
computed, Instead, the scores were converted 
into ranks and correlated by means of Ken- 
dall’s Tau (6). None of the correlations were 
significant at the .05 level. This is not unex- 
pected since the use of ranks discards avail- 
able information. A test for differences in lo- 
cation, however, using Wilcoxon’s ¢ for paired 
replicates (8), resulted in nine significant dif- 
ferences at the .05 level, which for 27 com- 


putations was significant beyond the 001 
level (9). These significant ¢’s are indicated 
in Table 2. 


ing from the data 


The main question aris 
oups of variables, 


was, which of the three gr 
“kind of interpretation” received, “group 
evaluation” of the S, and the “self-concept,” 
showed the most significant change in the per- 
ception of hostility from the Rorschach to the 
examiner rating situation. It is apparent from 
examination of Table 2 that the “kind of in- 
terpretation” given is involved in the greatest 
number of significant differences, seven. The 
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group evaluation shows five significant dif- 
ferences, while the self-concept shows four. 
The four significant groupings receiving a 
“friendly” interpretation show that these Ss 
perceived significantly less hostility in the ex- 
aminer than they did on the Rorschach. In 
other words, as compared to the amount of 
hostility they projected on the Rorschach, Ss 
who were told that they were “friendly” per- 
sons, perceived the examiner as being signifi- 
cantly more friendly and competent. The same 
is true of the three significant differences in- 
volving the “friendly” persons. Here, persons 
who were friendly, perceived little hostility in 
the examiner in comparison to the hostility 
they perceived on the Rorschach. This fact 
occurred despite the variation in the kind of 
interpretation received and in the perception 
of the “self.” On the other hand, a greater 
perception of hostility occurred on the ERS 
than Rorschach for the three “hostile” inter- 
pretation groupings and one “hostile,” per- 
sons group. Perhaps unexpected is the fact 
that hostile insightful persons (group evalua- 
tion “hostile,” self-concept “hostile”) per- 
ceived more hostility on the Rorschach than 
as a result of ego-threat (examiner situation). 
The self-concept “friendly” variable showed 
significant differences when interacting with 
the “friendly” interpretation variable, with 


Table 1 


mbinations (27) of the Va 


All Possible Co 
“Friendly,” Group Evalua' 


riables, Group I 
tion “Hostile,” 
“Hostile,” and Self-Concept “Friendly” 


nterpretation “Hostile,” Group Interpretation 
’ Group Evaluation “F riendly,” 


Self-Concept 
Number Nuper 
aa Vaabkė Subjects Variables 
20 Group evaluation “hostile” + self-concept “‘friendly”’ 
Jl persons fan “fet ” R 
Be Peete interpretation 20 Group evaluation “‘friendly" + self-concept “hostile” 
40 “Friendly” interpretation 20 Group evaluation “friendly” + self-concept “friendly” 
40 Group evaluation “hostile” 10 Group evaluation “hostile” + self-concept “hostile” 
40 Group evaluation ‘‘friendly” + “friendly” E N SANE v 
40 Self-concept “hostile” 10 Group evaluation hostile” + self-concept ‘‘hostile 
40 Self-concept "friendly" + ge Nee or ay 
6 ieee aor 4 “friendly” interpreta- 10 Group evaluation “‘hostile" + self-concept “friendly” 
20 Group evaluation “hostile” + ‘friendly 4 “friendly” interpretation 
20 Group evaluation "hostile" + “hostile” interpretation 10 Group evaluation “hostile” + self-concept “friendly” 
20 Group evaluation “friendly” + friendly" eerie those Foacriiaa ata 
GUN i 10 Group evaluation '‘friendly” + self-concept “hostile” 
3 PRT E + 4. “hostile” interpreta- + “friendly” interpretation 
20 one evaluation “friendly” + 10 Group evaluation “friendly” + self-concept “hostile” 
K 1 “i i “hostile” interpretation 
5 ‘a, aie! “friendly” interpretation + _interpı 0 : i 
30 et oem tote. z edie interpretation 10 Group evaluation friendly" ++ self-concept "friendly 
20 Si SA E “friendly” + “friendly” interpretation ae “friendly” interpretation i 
20 eeri “friendly” + “hostile” interpretation 10 Groupevaluation “friendly” 4- self-concept “friendly” 
“A Genie: CeT nation “hostile” "i" self-concept “hostile” + “hostile” interpretation 
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Table 2 


Groupings Showing Significant Differences Between RHS and ERS Scores as Determined by 
Wilcoxon Paired Replicate ¢ Tests 


N Groups 


ERS = perception of hostility 
higher in ERS than RHS 


RHS = perception of hostility 


b higher for RHS than ERS 

40 “Hostile” interpretation .05* ERS 
40 “Friendly” interpretation .05* RHS 
40 Group evaluation “friendly” 05* RHS 
20 Group evaluation “hostile” + “hostile” 

interpretation iga ERS 
20 Group evaluation “friendly” + “friendly” 

interpretation pise RHS 
20 Self-concept “friendly” -+ “friendly” 

interpretation .01*** RHS 
20 Self-concept “friendly” + “hostile” 

interpretation .05* ERS 
20 Group evaluation “hostile” + self-concept 

“hostile” .05* RHS 
10 Group evaluation “friendly” -+ self-concept 

“friendly” + “friendly” interpretation O1** RHS 


£ Significance beyond .05 level. 
ignificance beyond .02 level. 
Significance beyond 101 level, 


more hostility being perceived as occurring 


on the Rorschach than in the examiner. 
Lastly, those persons whose self concept was 
“friendly,” but who received a “hostile” in- 
terpretation, perceived more hostility in the 
examiner than they did on the Rorschach. 


Discussion 


The situational quality of projection would 
seem to be strongly emphasized by the results. 
Apparently, the objective Personality and the 
self-concept are less important than the kind 

i in which the § finds himself. Be- 
ing told that they were hostile caused the ma- 
jority of Ss to Project this hostility on to a 
suitable object (the examiner giving the in- 
terpretation) by Perceiving him as the “hostile 

report elicited in the main, 
the interpreter as hostile. 
not, however, the sole 


operation of projection. 
Those Ss who were “friendly” tended to per- 


ceive less hostility in the examiner as com- 
pared to the Rorschach no matter what kind 
of interpretation they received nor what their 
self-concept. The same was not true of the 
“hostile” Ss, who did not show any significant 


difference when considered as an entity. Ap- 
parently, the perceptions of “hostile” Ss were 
more readily influenced by changes in the en- 
vironment studied than was true of “friendly 
Ss. Nevertheless, hostile insightful Ss (group 
evaluation “hostile,” self-concept “hostile ) 
projected considerably more hostility on the 
Rorschach than in the examiner situation. 
That this fact is not due to the mere posses- 
sion of “hostility” may be gleaned from the 
fact that the group evaluation “hostile,” self- 
concept “friendly” group did not show aay 
significant difference in their perception O 
hostility in the two situations. It seems ae 
to conclude, therefore, that the projection 0 
hostility on the Rorschach in this study was 
a function of the possession of hostility in 
conjunction with insight into this fact. More- 
over, the fact that “friendly” Ss (without con- 
sidering their self-concepts) tended to mani- 
fest more hostile perceptions on the Rorschach 
than they did with regard to the interpreter 
seems at variance with some of the current 
thought about the Meaning of responses 
elicited by projective techniques, namely, 
that elicited responses are representative of 
a person’s phenomenological world. Appar- 
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ently, clinical psychologists might well take 
note of the fact that elicited hostile responses 
on the Rorschach may at times reflect only 
the person’s freedom from fear in expressing 
that which is indicative of his “life style.” 
Conversely, the absence of hostile responses 
in a protocol may for some persons be in- 
dicative not of nonhostile feelings, but rather 
of a reluctance or fear of expressing strong 
hostile feelings through perception on the Ror- 
schach. Indeed, from a psychotherapeutic 
point of view, those persons who are hostile 
but deny this fact (hostile—noninsightful) 
might be considered to be more deeply dis- 
turbed than those who are hostile, possess 
insight into this fact, and are willing to ac- 
knowledge their possession of hostility openly. 
Seemingly therefore, a revision of the rationale 
underlying the Rorschach is needed. | 1 

The concept of one’s “self” as friendly 1S 
of importance in interaction with other vati- 
ables. It is the only variable that showed a 
shift in the perception of the examiner from 
“friendly” to “hostile” when the kind of inter- 
pretation given was changed from sfriendi i 
to “hostile.” This serves to confirm the stan 
that these persons were operating nom k 
phenomenological frame 


of reference, in tha 
when the interpretation 


given was in accord- 
ance with the self-concept (“friendly” inter- 
pretation, “friendly” self concept) there wos 
little perception of hostility on the part of the 
examiner. W. 


hen the interpretation differed 
from the self concept (“hostile” interpreta- 
tion, “friendly” self concept), the perceived 
threat to the “self” resulted in the projection 
of the S’s hostility on to the interpreter. 
Summary 


indicate that Ss pro- 
jecting hostility in one situation (Rorschach) 
show significant differences from the tendency 
to perceive hostility in another situation (re- 
action through rating of the examiner’s inter- 
pretation of their protocol). These differences 
have been shown to be related to such vari- 
ables as kind of interpretation of their proto- 
col given to the Ss by the interpreter, group 
evaluation of the S by his fraternity brothers, 
and the S’s self concept. Although each of 
these variables was related to the perception 


The results seem to 


of hostility, the strongest determinant ap- 
peared to be the emotional climate created by 
the interpretation given to the Ss regarding 
their Rorschach performance. Those Ss called 
“hostile” reacted to this threat to the “self” 
by rating the interpreter as “hostile.” Those 
Ss called “friendly” rated the interpreter as 
competent and “friendly.” 

An additional finding was that “friendly” 
Ss tended to perceive more hostility on the 
Rorschach than they did in the examiner rat- 
ing situation. This finding was not true of 
“hostile” Ss whose perceptions were influenced 
by whether they received a “friendly” or 
“hostile” interpretation of their Rorschach 
protocols. Lastly, the finding that “friendly” 
Ss, and “hostile-insightful” Ss showed a sig- 
nificantly greater production of hostile re- 
sponses on the Rorschach than in the ex- 
aminer rating situation seems to warrant 
further investigation as to the meaning of 
responses obtained on the Rorschach. 
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of choice and social desirability obtained in 
this study is comparable to the correlation of 
.87 reported by Edwards (2) when his items 
were administered in the “Yes-No” type of 
inventory. While the 30 item pairs upon which 
the present correlation is based is relatively 
small, the correlation appears to be more 
likely the result of the method used to judge 
social desirability rather than the result of a 
biased or restricted sample. It would seem 
that, from responses to single items, one can- 
not generalize with impunity about the in- 
fluence of social desirability on forced-choice 
pairings. Our findings suggest that paired 
items can acquire contextual meaning which 
alters the values assigned to the same items 
when responded to separately, They are con- 
sistent with other investigations, e.g., Howes 
and Osgood (5), which demonstrate the influ- 
ence of context in changing the meaning of 
individual words. It appears likely that Ed- 
wards, in using the method of successive in- 
tervals to scale his items, achieved only a first 
approximation of equal pairings and that ad- 
ditional judgments of the item pairs them- 
selves are necessary along with revisions in 
pairing before the variable of social desir- 
ability can be eliminated from the EPPS. 


Summary 


The present study investigated the extent 

which social desirability influences re- 
Sponses to a short form of the Edwards Per- 
sonal Preference Schedule. The results indi- 


to 


Corah, Feldman, Cohen, Gruen, Meadow, and Ringwall 


cate that the factor of social desirability is 
still an important influence since, in a sta- 
tistically significant number of item pairs, 
judges had a definite preference for one mem- 
ber of the pair as being more desirable. Also, 
the preferences of judges in terms of social 
desirability correlated highly with actual 
choices of another group of Ss who took the 
scale as a standard personality test. 
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This study represents an attempt to vali- 
date certain psychiatric diagnostic entities, 
using the technique of obverse factor analy- 
sis to establish modal patterns of symptom 
groupings. If clinical classifications of pa- 
tients are valid, they should divide patho- 
logical traits into syndromes. It was the prob- 
lem of this paper to test the existence of 
four distinct disease reactions corresponding 
to psychiatric diagnoses in an outpatient 
population, and to establish by means of the 
technique of obverse factor analysis patterns 
of characteristics common to the members of 
each group and not possessed by members of 
other groups. 

Procedure 
Subjects 

The Ss were 20 male veterans who were 
receiving psychotherapeutic treatment in the 
Veterans Administration Mental Hygiene 
Clinic of the Washington, D. C., regional of- 
fice. Their ages ranged from 25 to 44 years, 
with a median age of 32 years. Five Ss were 
selected from each of the following four diag- 
nostic categories: Hysteric, Anxiety State, 
Schizophrenic, and Obsessive-Compulsive. At 
least two medical diagnoses were used in the 
selection of the psychoneurotic Ss. The thera- 
pist’s diagnosis was confirmed by a Concur- 
ring diagnosis from another source. 

A somewhat different procedure was fol- 
lowed in the selection of schizophrenic Ss. 
Since these Ss had not been hospitalized, and 
prodromal symptoms had in some instances 


1 This article represents a treatment of enetot ae 
problems included in a doctoral dissertation, meee 
University of America. It was carried out using the 
facilities of the Veterans Administration Mental Hy- 
giene Clinic, Washington, D. C. 
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been previously described as an “anxiety 
state,” no confirming medical diagnosis was 
secured on these patients. They were selected 
on the basis of the current diagnosis of their 
respective treating physicians plus case his- 
tory. 


Measures 


The measures consisted of 67 rating scales 
which were essentially the same as those ana- 


Table 1 
Oblique Factor Matrix V = F A 


Factor 


Variable A % B c D 
1. H-1 .07 .29 31 —.02 
2. H-2 —.26 —=.11 —.02 —.49 
3. H-3 .02 01 -69 —.03 
4. H-4 13 .00 —.04 —.49 
5. H-5 —.23 44 13 .02 
6, A-1 —.20 49 “ld -.01 
7. A-2 —.08 44 58 26 
8, A-3 —.29 33 —.17 —.10 
9. A-4 .00 oT 01 04 
10, A-5 —.25 «19 40 .29 
11, S-1 20 —.17 —.03 —.36 
12. S-2 38 13 38 12 
13. S-3 32 ld .27 .07 
14, S-4 .05 229 —.26 —.03 
15. S-5 16 19 —.22 .07 
16. O-1 39 16 —.44 —.17 
17, O-2 37 —.07 —.04 —.04 
18. 0-3 60 07 —.07 —.03 
19. O-4 58 —.01 —.36 —.17 
20, O-5 66 —.03 .00 —.05 


lyzed by Lorr and Rubinstein (9) in an R- 
type factor analysis using a population of 
psychiatric outpatients. The following are ex- 
amples of the kind of traits which the scales 
were designed to measure: Emotional Reac- 
tivity, Concern with Conformity, Hostile Pas- 
sive Obstructionism, Compulsions, and Gas- 
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Table 2 


Trait Composition of Primary Factors 


Primary Factors 


ss Scale Description A B c R 
1 Underreacts emotionally—overreacts + os z 
2 Depressed—elated T a 
3 Even in mood—mood swings + _ T gi 
4 Inhibited—uninhibited $ ui pi 
5 Tense—phlegmatic = ae 
6 Concerned with self—unconcerned _ 
r Lacking self-assurance—self-assured EJ T j 
8 Selfconscious—unselfconscious F ov, 
9 Submissive—dominant + a 
10 Rigid—flexible + = 
11 Outgoing—seclusive T i 
12 Poorly adjusted socially—gains acceptance F $ K 
13 Rarely sees a task through—perseveres = $ = 
14 Effeminate—masculine 
15 Unsatisfied need for affection—no unsatisfied need ga - 
16 Egocentered—nonegocentered + + of 
17 Seeks support from others—does not seek support = 
18 Lacks initiative—acts independently Be neat sa 
19 Avoids responsibility—accepts responsibility £ a Jy 
20 Feels rejected—feels accepted 
21 Perceives world as hostile—perceives world as f riendly T + 
22 High level of achievement—low level of achievement na fs 
23 Considers the future—does not consider the future = + 
24 Strong superego—weak superego =- + 
25 Impulse control—lack of impulse control + = + 
26 Orderly—disorderly aig $ + 
27 Perfectionistic—unconcerned with tasks = + + 
28 Concerned with conformity—nonconformist = 
29 Hostile to authority—accepts authority + = + 
30 Blames self—does not blame self pi + s 
31 Projects blame—does not project blame q < + 
32 Denies the existence of difficulties—exaggerates difficulties = + 
33 Has insight—lacks insight ~ 


34 Overt hostility. 


—No overt hostility 
35 Hostile withdr: 


‘awal—no hostile withdrawal 5 + i" - ga 
36 Hostile passive obstructionism—no hostile passive obstructionism P rs 
37 Interested in activities around him—lacks interest = 
38 Frustration tolerance—lacks f rustration tolerance j G + 
39 Needs approval—does not need approval 
40 Suspicious—trustful $ 
41 Concerned over hostility—unconcerned = 
42 Overconcerned with Symptoms—unconcerned with symptoms + T 
43 Autism—no autism + T 
44 Anxious—unworried t + ga 
45 Hostile—not hostile + + = 
46 Trritable—not irritable = = 2 
47 Unrealistic ambition—no unrealistic ambition + ci y 
48 Sex conflict—no sex conflict 4 
49 Uses complaints—no use of complaints i E 
50 Unreality feelings—no unreality feelings = P 
51 Phobias—no phobias + F F 
52 Suicidal thoughts—no suicidal thoughts = of a ~ i 
53 Reality distortion—no reality distortion Po = = \ 
54 Ideas of 1eference—no ideas of reference + 
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Table 2—Continued 


Primary Factors 


Scale 

No. Scale Description A B c D 
55 Obsessive thoughts—no obsessive thoughts = + 
56 Obsessive hostile impulses—no obsessive hostile impulses al 

i 57 Compulsions—no compulsions = = ra 

58 Alcoholic addiction—no alcoholic addiction = che ma 
59 Marked behavioral reaction to alcohol—no behavioral reaction to alcohol = 
60 Conversion symptoms—no conversion symptoms 4 
61 Anergic complaints—no anergic complaints + = 
62 Body preoccupation—no body preoccupation r3 
63 Headaches—no headaches $ BE re 
64 Sleep difficulties—no sleep difficulties + 
65 Intestinal symptoms—no intestinal symptoms + - S 
66 Gastric symptoms—no gastric symptoms - - + = 
67 Cardiovascular symptoms—no cardiovascular symptoms - - + 


tric Symptoms. The form of the rating scales 
| is illustrated below: 


Trait 28. Concern with Conformity: 
ic concern for con- 


1. Shows excessive and chron 
hesitate 


formity with standards of the group. Would 


long before committing a violation. 
2. Shows a fairly strong concern over adherence 


to social conventions. Feels uncomfortable if he is 


not conforming. 
3. Shows a slightly more than average concern 
1 conventions. 


> . 
i over adherence to socia! 
average concern over 


4. Shows somewhat less than 
ions. 


adherence to social convent: 7 
over disregard of social 


| 5, Shows little concern 


conventions. 
| 6. Shows no concern over disregard of social con- 
ventions. 
X. Unrateable. (Specify) 


made to control the effect of changes that 
might have taken place during the therapeutic 
process by instructing the therapist to refer 
to the notes of his earliest sessions in rating 
those patients who, he felt, had changed un- 
der treatment. The data analyzed included 
ratings by psychiatrists, clinical psychologists, 
and social workers. To insure comparability of 
ratings, a rating guide was distributed to each 
person responsible for evaluating a patient. 
Further clarification was obtained by devot- 
ing a two-hour staff conference in the partici- 
pating clinic to a discussion of scale items. 


Table 4 


Relations of Oblique Reference Vectors to One Another 
A‘A-Direction Cosines 


Ratings were secured from each patient’s 
individual therapist. Since the patients had Vector A B C D 
been in therapy for varying lengths of time ix 
(one month to two years), an attempt was B _28 
c —.05 61 
Table 3 D —.55 ‘67 60 
Oblique Reference Vectors in Relation to 
Unrotated Factors Table 5 
i Rotation Matrix A Relations of raan Saon to One Another 
E Reference Vectors (A'A) D 
Unrotated 
i Factors A B c D Factor 7 Te T Ji 
I 48 212 — 36 02 Ta 
I 18 B =B AL Ts 00 
ur 76 19 57-18 Te sa 
IV -sa 92 O 89 Ta < o Se 
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Table 6 
Unrotated Factor Matrix F,* 


Table 8 


Rotation Matrix A, 


Second-order Factor Factor X Y 
Primary = = 
I II Ty 675 223 
Factor a s a a poe 
A -107 -236 
B —.192 098 
£ E = as to retain an orthogonal structure. The fac- 
. —,.49 


a Subscript indicates second-order factors. 
Design 


The technique of obverse factor analysis 
was used to determine whether the four diag- 
nostic entities could be reproduced statisti- 
cally and also to determine any inherent 
relations among these so-called entities. The 
resulting factors might be considered as rep- 
resenting types of pathological adjustment, 
which could further be described in terms of 
the individual traits they comprise. 

Tetrachoric correlations were obtained 
among the 20 Ss, 5 from each diagnostic 
category. Traits were dichotomized at the in- 
terval nearest the median of the 20 patients. 


Using Thurstone’s (12) centroid method of 
factor analysis, loadings on four factors were 
extracted from the 


20 X 20 correlation matrix. 
Factor extraction was stopped when the dis- 
tribution of residual 7’s around zero approxi- 
mated a chance distribution. Rotation to sim- 
ple structure was Carried out according to the 
bed by Thurstone (12, pp. 194~ 


» Yielding two 
second-order factors, These were rotated so 


Table 7 
Rotated Factor Matrix V, = F,A, 


Second-order Factor 


Primary Bois 
Factor xX y 

A 530 001 

B — 026 514 

C =422 ~ 233 

D 067 —.359 


tors arrived at statistically were examined as 
to the personality pattern they delineate and 


compared with present psychiatric concepts 
of disease entities. 


Results 


The Rotated (oblique) Factor Matrix is 
given in Table 1.* The following procedure 
was used in identifying primary factors: three 
individuals were selected as representatives of 
each factor, taking into consideration both 
saturation with that factor and relative pur- 
ity, freedom from loadings on other factors. 
Factor A was represented by individuals O-3, 
0-4, and O-5; Factor B by H-5, A-1, and 
A-4; Factor C by H-3, A-2, and A-5; and 
Factor D by H-2, H-4, and S-1. A trait was 
considered as contributing to a factor when 
all of the three representatives of the factor 
fell on the same side of the median in the 
trait as rated. The composition of the factors 
in terms of traits derived by this procedure 
is presented in Table 2. A pattern of distin- 


Fig. 1. Rotation of second-order factors. 


? Correlation and centroid factor matrices may be 
obtained without charge 


from Mary H. Tatom, 3801 
Connecticut Ave., Washington 8, D. C., or from the 
American Documentation Institute, Order Document 
No. 5434, remitting $1.25 for microfilm or $1.25 for 
photocopies, 


Factorial Isolation of Outpatient Syndromes 77 


Table 9 
Factor X 


Scale Description 


Scale 
No. Positive Negative 
2 Depressed vs. Elated 
3 Even mood vs. Mood swings 
7 Conspicuously lacking in self-assurance vs. Self-assured 
9 Submissive vs. Dominant 
10 Rigid vs. Flexible 
il Seclusive vs. Outgoing 
12 Poorly adjusted socially vs. Gains acceptance socially 
37 Little interest in activities around him vs. Interested in activities around him 
49 Uses complaints vs. Does not use complaints 


guishing traits for each primary factor was 
derived from Table 2 by assigning to each pri- 
mary factor those traits which differentiated 
it from all others, i.e., those traits which were 
not represented at all in any other factor, or 
which were not represented similarly (as to 
presence or absence) in another factor. Fur- 
ther discussion of the trait composition of 
primary and second-order factors will be in 
terms of these distinguishing (pathogno- 
monic) traits. 
The cosine matrix (Table 5) of the pri- 
mary factors was factored to obtain second- 
rs. The two second-order fac- 


order paramete r 
tors were plotted as a step toward their or- 


thogonal rotation. Inspection of this plot 
shown in Fig. 1 indicates certain interesting 
relationships. The rotation indicated by dotted 


lines in Fig. 1 and as completed in Table 7, 
permitted a tentative identification of Factor 
X by examining those traits which differenti- 
ated between Factors A and C and were in no 
way involved in Factor B. Traits which dif- 
ferentiated between Factor C and Factor D 
were included if they were not involved in 
Factor B. Second-order Factor Y was tenta- 
tively identified by isolating those traits which 
were peculiar to B (for which there was no 
indication in other factors) or which differ- 
entiated between B and D and did not dif- 
ferentiate between A and C. Of this group of 
traits, those which showed some relationship 
between D and either A or C were omitted, 
since D had some loading on X. Traits of 
second-order Factors X and Y are given in 
Tables 9 and 10, respectively. 


Table 10 
Factor Y 


Scale Description 


No. Positive Negative 
4 Uninhibited vs. Inhibited 
13 Rarely sees a task through vs. Perseveres 
14 Effeminate vs. Masculine 
15 Unsatisfied need for affection vs. No unsatisfied needs to be loved 
24 Lack of superego vs. Severe superego 
26 Disorderly vs. Orderly 
27 Unconcerned with tasks vs. Perfectionistic 
28 Does not conform vs. Concerned with conformity 
33 Lack of insight vs. Insight : 
42 Overconcerned with symptoms vs. Not concerned with symptoms 
bias vs. Phobias 
2 No pho vs. No suicidal impulses 


52 Suicidal impulses 
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Discussion 


The factors isolated statistically divided pa- 
tients into groups which cut across clinical 
diagnostic classifications. The clinically diag- 
nosed Obsessive-Compulsives clearly defined 
Factor A. Factor B showed heaviest loadings 
in two patients who had been clinically diag- 
nosed as Anxiety State and one patient who 
had been diagnosed Hysteric. The three in- 
dividuals with highest loadings in Factor C 
had been diagnosed as Anxiety State (two pa- 
tients) and Hysteric (one patient). The nega- 
tive pole of Factor D was defined by two per- 
sons who had been diagnosed as Hysteric and 
one who had been diagnosed as Schizophrenic. 
In terms of traits, the syndromes derived by 
statistical analysis have been tentatively re- 
lated to clinical concepts as follows: 


Primary factors 
Factor A—Outpatient paranoid schizo- 
phrenic 
Factor B—Conversion hysteric 
Factor C—Intrapunitive, socially mature 


personality vs. narcissistic per- 
sonality 


Factor D—Passive dependent personality 
vs. anti-social personality 
Second-order factors 
Factor X—Schizothymia vs. cyclothymia 
Factor Y—Uncontrolled emotionality vs. 
Overcontrolled emotionality 


Factor A 


It will be observed t 
not involved in Factor 
reality distortion, flatt 
noid ideation: 


hat traits specific to A, 
X, are traits implying 
ened affect, and para- 


Trait No. 


1 Underreacts emotionally, 
21 Perceives world as hostile, 
34 No overt hostility. 

40 Suspicious, 

47 Unrealistic ambition, 

53 Reality distortion. 

54 Ideas of reference, 

58 No alcoholic addiction, 
64 Sleep difficulties, 

65 Intestinal symptoms, 


This symptom pattern appears to be classi- 
cally schizophrenic. Clinically diagnosed ob- 
sessive-compulsive neurotics formed a homo- 


geneous group on the basis of the pattern of 
traits represented by Factor A, while clinically 
diagnosed schizophrenics showed relatively 
low loadings on all factors. The finding that 
clinically diagnosed schizophrenics had little 
common factor variance in this analysis sug- 
gests that certain essentially schizophrenic 
characteristics were not covered by the rating 
scales used. It is possible that paranoid schizo- 
phrenia developing in an obsessive-compulsive 
personality structure presents a consistent 
pattern, while other types of incipient schizo- 
phrenia show such varied overt symptoma- 
tology that early schizophrenia as such can- 
not be isolated as a clear-cut entity. Clinicians 
are familiar with the wide variety of behavior 
on which the diagnosis of incipient schizo- 
phrenia may be based: panic states, bizarre 
acting out behavior, a definite change in per- 
sonality, and general intellectual or behavioral 
disorganization. The patients who define Fac- 
tor A resemble ambulatory schizophrenics 
whose adjustment is stabilized at the level of 
minimal social functioning, who retain some 
controls, and who are not at present threat- 
ened with an acute psychotic episode. Such 
patients might receive the diagnosis of obses- 
sive-compulsive neurotic on the basis of char- 
acterological features such as rigidity, inhibi- 
tion, and absence of overtly hostile behavior, 
though neurotic symptoms were not present. 

Factor A is somewhat similar to Lorr and 
Rubinstein’s (9) Factor B and (10) Factor 
G, and to the negative poles of Cattell’s (4) 
Factors A, H, and L. 


Factor B 


Factor B is composed of a group of charac- 
teristics descriptive of unrestrained emotional 
behavior. The syndrome isolated here corre- 
sponds to some extent to the General Emo- 
tionality factors of Burt (2), Eysenck (6); 
Rao and Slater (11), and Cattell (4). In the 
present study, poor emotional control, an un- 
satisfied need for love and care, and lack of 
insight are associated with conversion symp- 
toms. In terms of psychiatric formulations, 
the group of traits which make up Factor B 
are those usually associated with conversion 
hysteria. The patients who defined this factor 
had been diagnosed Anxiety State (two pa- 
tients) and Hysteric (one patient). 


vaa ë y ai 
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Factor C 


Factor C is a bipolar factor, described at 
its positive pole by a group of patients who 
are socially adjusted, independent, and non- 
egocentered. On the pathological side, they 
tend to assume blame and present gastric 
symptoms. Perhaps in a clinic population, in- 
dependence and cooperativeness are achieved 
at the expense of inner strain. The negative 
pole of Factor C is characterized by a group 
of traits which involve a hostile, passive, and 
egocentered adjustment which corresponds to 
the clinical concept of narcissistic character 
disorder. The diagnosis Inadequate Person- 
ality is sometimes applied to this type of pa- 
tient. Though the negative pole of the factor 
is not defined by a group of patients, two of 


„the clinically diagnosed obsessive-compulsives 


show significant negative loadings on Factor 
C (using .35 as a criterion of significance). 
The patients who defined Factor C had been 
clinically diagnosed Anxiety State (two pa- 
tients) and Hysteric (one patient). 

Traits which are specific to Factor C which 
do not appear in Factor X are as follows: 


16 Nonegocentered vs. egocentered. 

18 Acts independently vs. lacks initiative. 

30 Blames self vs. does not blame self. y 
36 No hostile passive obstructionism vs. hostile 


passive obstructionism. 
45 Not hostile vs. hostile. 


46 Not irritable vs. irritable. : 
66 Gastric symptoms vs. no gastric symptoms. 


The dimension involved in Factor C appears 
to be basically one of unselfishness vs. selfish- 
ness. Factor C resembles somewhat Lorr and 
Rubinstein’s (9) Factor E, which they termed 
dependent immaturity vs. independent ma- 
turity. It is also similar to Cattell’s (4) 
Source Trait A. Factor C corresponds in gen- 
eral to the surface trait which Cattell (4) de- 
scribes as infantile, demanding self-centered- 
ness vs. emotional maturity, frustration toler- 
ance. 


Factor D 

Factor D cannot be definitely described as 
a bipolar factor. However, since it is defined 
by a group of patients at its negative pole, 
positive loadings approach significance (.29), 
and the factor loadings in both directions are 


relatively low (— .49 to .29), characteristic 
of both poles are presented. 

Traits specific to D, not involved in second 
order factors are as follows: 


5 Phlegmatic—tense. 
6 Sar preoccupied—attentive to external mat. 
ers. 
17 Seeks support from others—self-sufficient, 
31 Does not project blame—projects blame, 
32 Denies frustration—exaggerates frustration. 
39 Needs approval—does not need approval. 
41 Concerned over hostility—unconcerned over 
hostility. 
48 Sex conflict—no sex conflict. 
56 No obsessive hostile impulses—obsessive hos- 
tile impulses. 
59 No behavioral reaction to alcohol—marked be- 
havioral reaction to alcohol. 
62 No body preoccupation—body preoccupation. 
63 No headaches—headaches. 
67 Cardiovascular symptoms—no cardiovascular 
symptoms. 


This factor presents a syndrome character- 
ized at its positive pole by submissiveness, 
inner conflict, insecurity, guilt, and depend- 
ency and at its negative pole by conflict with 
authority, aggression, absence of guilt, and 
self-sufficiency. Cardiovascular symptoms are 
associated with the former and headaches with 
the latter. Introversion, guilt, conflict, and 
inhibition describe a personality structure as- 
sociated with the diagnosis of anxiety neu- 
rosis, and cardiovascular symptoms may per- 
haps be an autonomic expression of anxiety. 
The factor under consideration has been re- 
lated to the clinical diagnosis Passive De- 
pendency Reaction because of the absence of 
overt anxiety symptoms; however, inner con- 
flict and inadequacy feelings appear to be cen- 
tral to this syndrome, one of extreme inner 
discomfort. The basic dimension of Factor D 
is one of submission to outer authority and 
to superego dictates vs. rebellion against outer 
authority and absence of guilt. The cluster of 
traits which characterizes the negative pole 
of Factor D suggests a psychopathic deviate 
syndrome. The dimension represented by Fac- 
tor D appears to be very similar to Eysenck’s 
(6) factor which divided his population into 
a social misfit vs. a psychological conflict 
group. It also corresponds to some degree to 
Rao and Slater’s (11) factor, obsessive-com- 
pulsive vs. psychopath. Lorr and Rubinstein’s 
Factor D, which they described as a dimen- 
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sion of inadequacy feelings, is very similar to 
Factor D. In both factors, headaches are as- 
sociated with absence of conscious inferiority 
feelings. Cattell’s (3) Source Trait E, ascend- 
ance vs. submission appears also to be com- 
parable to Factor D. 


Factor X 


This second-order factor has been termed 
a schizothymia vs. cyclothymia dimension in 
terms of the traits of Factors A and C which 
define its positive and negative poles respec- 
tively. In factorial studies, a schizothyme- 
cyclothyme factor has frequently appeared, 
and each pole has appeared as a separate fac- 
tor at times. Cattell (3) concludes that this 
dimension represents a basic temperamental 
difference in people, corresponding to Kretsch- 
mer’s dichotomy based on body type. 


Factor Y 


Factor Y represents a dimension defined at 
ts positive pole by primary Factor B. Factor 

appears to be similar to the negative pole 
of Cattell’s (4) Factor C and to the factor 
General Emotionality found by Eysenck (5), 
by Rao and Slater (11), and by numerous 
other analysts, 

Perhaps the fact that clinical groupings of 
patients were lost in the statistical analysis 
can be explained to some extent by the ob- 
servation that obverse factor analysis may 
classify individuals into types on the basis of 
underlying generalities rather than on readily 
observable surface characteristics. In an ob- 
verse analysis of four types of geometrical 
solids (cones, rectangular prisms, rectangular 
pyramids, and cylinders), Lorr, Jenkins, and 
Medland (8) found that rotation yielded two 
bipolar composite fact 
curvilinear vs. nont 


i 


actors, nor could 


sory information. 
ted results compa- 
nt investigation in 


Bom Mo Chung (1) repor 
rable to those of the prese 


Mary H. Tatom 


a study in which he attempted to arrive at 
genetic species by an obverse factor analysis 
of the correlations between species based on 
14 genetic traits. He found only rough co- 
incidence of factorial types with conventional 
genetic species, but felt that this did not in- 
validate the technique, since factorial types 
might furnish a valid basis of classification 
independent of other classifications of the 
data. Lorr and Fields (7) in a factorial study 
of body types found Sheldon’s three compo- 
nents to represent patterns which could be 
accounted for by two factors best described 
as muscle or fat, leg length or torso length. 
Primary factors in the present analysis are 
highly intercorrelated; perhaps the addition 
of other traits might define them more clearly. 
It is felt that second-order factors were clearly 


established in the present analysis, but that” 


primary factors require cross-validation. Pri- 
mary factors were so heavily saturated with 
second-order factors that clusters of patients 
may have been formed largely in terms of 
only two dimensions, obscuring some clini- 
cally observable differences between patients 
and accounting to some extent for discrep- 
ancies between psychiatric and clinical clas- 
sifications. 

The results of the present study cannot be 
said to validate or invalidate either factorial 
classification of patients or their classification 
by conventional psychiatric nosology. It does, 
perhaps, explain to some extent the frustra- 
tion involved in attempting to validate psy- 
chological measures against clinical diagnoses. 


Summary 


The present investigation represents an at- 
tempt to test by the technique of obverse fac- 
tor analysis the existence of four distinct dis- 
ease reactions Corresponding to psychiatric 
diagnoses in an outpatient population and to 
establish patterns of traits characteristic of 
each syndrome. 

Factorially isolated Syndromes cut across 
clinical diagnostic lines, separating patients 
into groups which were different from the 
categories into which they had been placed by 
clinical diagnosis. The lack of agreement be- 
tween factorial and psychiatric groupings of 
individuals was not thought to invalidate 
either system of classification. 


a 


Factorial Isolation of Outpatient Syndromes 


Traits were grouped by this study into ag- 
gregations which formed recognizable clinical 
entities and corresponded in general to fac- 
tors isolated in other factor analyses. Pri- 
mary and second-order factors were tenta- 
tively identified as follows: 


Primary factors 

Factor A—Outpatient 
phrenic. 

Factor B—Conversion hysteric. 

Factor C—Intrapunitive, socially mature 
personality vs. narcissistic per- 
sonality. 

Factor D—Passive dependent personality 
vs. anti-social personality. 


paranoid schizo- 


Second-order factors 
Factor X—Schizothymia vs. cyclothymia. 
Factor Y—Uncontrolled emotionality vs. 
overcontrolled emotionality. 


Received March 25, 1957. 
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New Test 


Lorge, Irving, & Thorndike, Robert L. Lorge-Thorn- 
dike Intelligence Tests. Grades kgn.-12. 5 levels, 2 
forms at each level. Primary Battery (levels 1-2), 
(30) min., test booklet ($3.00 per 35), with key, 
record sheet, and manual, pp. 20. Verbal Battery 
(levels 3-5), 34 (45) min., or Nonverbal Battery 
(levels 3-5), 27 (40) min. Consumable edition: 
test booklet ($2.40 per 35), with key, record sheet, 
and manual, pp. 32. Re-usable edition: test book- 
let ($2.40 per 35), with manual; IBM answer — 
sheet ($1.20 Per 35), with record sheet; IBM or 
hand-scoring key (21¢ ea.). Technical manual, pp. 
16 (124), Boston: Houghton Mifflin, 1957. 


_ The Lorge-Thorndike Intelligence Tests comprise 
cee different tests which span the range from kin- 
en through high school. Each is available in 
© equivalent forms, and the three higher levels are 
urnished in two formats for use with or without 
erate answer sheets. For the Primary Battery, on 
u levels covering kindergarten and the first three 
oe es, administration is oral and responses are made 
y marking pictures, Three types of items—oral vo- 
cabulary, pictorial classification, and pictorial pair- 


ing—are used, Levels 3 to 5, covering the range from 
Grade 4 to Grade 12, are provided with verbal and 
nonverbal batteries in Separate booklets. The subtests 
of the Verbal Battery are word knowledge, sentence 
completion, verbal classification, verbal aaloe 
and arithmetic reasoning, The Nonverbal Battery is 
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figure analogies, figure classification, and number 
series, } 

The Technical Manual shows that the development | 
and standardization of the tests involved the exami- 
nation of more than 136,000 children in 44 communi- | 
ties in 22 states. Norms were based on a stratified)” 
sampling of communities rated in five groups by 
socioeconomic criteria. For all levels and tests, fou 
types of norms may be read directly from rawi 
scores: deviation IQs (M=100, SD=16), grad 
percentiles, grade equivalents, and age equivalen 
Other technical data are fully presented and impre 
sive. Alternate form reliabilities in single-grade sam- 
ples range from .76 to .89 with, not unexpectedly, 
the higher reliabilities appearing in the verbal tests 
at the higher levels. Corrected split-half reliabilities 
for single-grade groups run from .88 to 194. Verbal 
and nonverbal batteries correlate about .65. A factor 
analysis of the subtests shows that verbal and non- +44 
verbal factors account for most of the variance, Con- 
gruent validities with other appropriate tests are 
about .65, and the one reported study of predictive 
validity shows a correlation of scores and subsequent 
ninth-grade achievement to be .67. 

These tests have many merits in their well-planned 
and attractive formats and their numerous conven- 
iences for use. But their greatest strength is the ho- 
mogeneous content and the common standardization 
over so wide a range of developmental levels. They 
will give excellent service for many applications tO 
educational administration, classification, and guid- 
ance—L. F. S. 


Journal of Consulting Psychology 
Vol. 22, No. 2, 1958 


Relationship Between Certain Personality Variables 
and Continuation in Psychotherapy’ 


Earl S. Taulbee 


VA Mental Hygiene Clinic, Omaha, Nebraska 


It is obvious from the wide range of vari- 
ables (pertaining to patient, therapist, tech- 
nique, environment, and the interaction of 
these) which have been found to be associated 
with continuation and improvement in psy- 
chotherapy, that the process and outcome of 
treatment are extremely complex. In general, 
studies reported to date offer support for the 
relationship between such factors as socio: 
economic status, education, intelligence, and 
number of interviews to continuation in psy- 
chotherapy and to its outcome. Very little re- 
search has been done on the role of specific 
personality variables in the process of treat- 
ment. Because of the limited facilities avail- 
able for treatment, accurate prognosis is a 
very important problem. 

Cartwright (2) studied the outcome of 38 
clients seen in client-centered therapy. He in- 
terpreted the relation found between success 
ratings and length of therapy as suggesting 
that certain individual differences between 
clients give rise to different kinds of thera- 
peutic process. Two kinds of process were 
identified as: “short” (1-12 interviews) and 
“Jong” (13-77 interviews). Very similar re- 
sults were reported by Taylor (9) using cases 
seen in a psychoanalytically oriented VA men- 
tal hygiene clinic. These two studies offer 
some evidence that continuation and rated 
improvement in therapy are more a function 
of personality differences in clients than the 
type of therapy employed. Gallagher | (4) 
found that the more anxious the individual 


the more likely he would be to remain iny vation of the “symptom” scales of the MMPI 


therapy and the more defensive the individual 
the greater the likelihood of his prematurely 


1From the Veterans Administration Mental Hy- 
giene Clinic, Omaha, Nebraska. 
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leaving therapy. Investigating the differences 
between a group of patients rated improved 
and an unimproved group, Rosenberg (6) 
found that the improved showed higher IQ, 
greater productivity, greater emotional depth 
and responsiveness, more sensitivity and tact, 
and higher energy level and drive for achieve- 
ment. The unimproved showed more stereo- 
typy and more preoccupation with physical 
complaints. Mowrer suggested that “. . . de- 


pression, inferiority feeling, anxiety, and other 


painful affects which the neurotic experiences 
are signs of strength within the personality 
- an individual with internal disharmony 
who is experiencing these distressing emotions 
is not nearly so badly off as he would be if, 
under the same circumstances, he were bland, 
unconcerned, unmotivated” (5, p. 91). 


Purpose of the Present Study 


It is the author’s opinion that certain 
identifiable personality variables are associ- 
ated with the premature termination of, or 
continuation in, individual psychotherapy. 
Furthermore, regardless of the way in which 
these interact with other important variables 
in the therapeutic relationship, they will be 
reflected in certain psychological tests. The 
following specific hypotheses were tested: 

Hypothesis 1. Certain symptoms and af- 
fects, as revealed by specific MMPI scales 
and Rorschach variables, are positively re- 
lated to continuation in psychotherapy: 

(a) The “continuers” show a greater ele- 


(Hs, D, Pa, Pt, and Sc) than the “attriters.” 

(6) The continuers give a larger number 
of color (C), shading (VY), vista (V), and 
anatomy (Az) responses on the Rorschach 
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Table 1 
Comparison of Continuer and Attriter Groups on MMPI Scales 


Continuers Attriters 

MMPI Scale Mean SD Mean SD f p 
? 8.27 11.13 8.08 10.70 08 N.S. 
L 3.60 1.99 4.50 2.59 1.79 Nis 
F 6.02 3.91 5.13 3.16 1.13 N.S. 
K 12.38 5.16 12.98 4.89 54 N.S. 
Hs 80.36 15.46 77.38 11.57 .98 N.S. 
D 78.29 15.47 70.43 12.40 2.53 025 
Hy 74.91 10.21 70.85 8.10 1,99 05 
Pd 59.91 12.50 60.58 11.46 25 N.S. 
Mf 57.96 10.23 51.55 9.59 2.93 .01 
Pa 60.64 10.39 53.83 10.37 2.98 .005 
Pt 73.87 15.73 65.05 15:32 2.58 -025 
Sc 69.58 15.13 60.05 13.42 3.02 .005 
Ma 56.69 9.41 56.25 9.51 21 N.S. 
Es 38.34 7.03 ` 40.33 5.74 1.40 N.S. 

Note.—Raw i 2 Rs (E e 

A ed less than Wale indented fd gad Ee Rep strengtiny ts CS l often acala aire otherwise two-tailed test 


’ (and a greater number of continuers give such 
responses). 


Hypothesis 2. The continuers are less de- 
fensive as reflected by their rejecting fewer 
cards (and fewer cases rejecting cards) and 
having a lower F% and A%. 

Hypothesis 3. The continuers manifest a 
more persistent mental attitude by giving a 


greater number of total responses (R), and 


a greater number of space responses (S) (and 
a greater number of 


cases give § responses). 
Hypothesis 4. The e Ses moc cae 
resemble a group of “normal” subjects when 
compared on the basis of R, F%, A%, num- 
ber of cards rejected, and total number of S, 


C, Y, V, and An responses, than do the at- 
triters. 


Subjects and Procedure 


The 85 patients were veterans in a men- 
tal hygiene clinic who had been diagnosed 
psychoneurotic without organic complications 
and who had been administered both the Ror- 
schach and MMPI during the intake pro- 
cedure. The patients were divided into two 
groups to conform to the “short” and “long” 
therapeutic processes suggested by Cart- 
wright: (a) 40 subjects who terminated 
treatment prior to the 13th interview, who 
are referred to as the “attriters” (mean age 


ee 


= 


33.45, SD 7.52; mean education 10.30 years, 
SD 2.14); (b) 45 subjects who remained in 
treatment for 13 or more interviews, who are 
referred to as the “continuers” (mean age 
33.60, SD 7.25; mean education 10.93 years, 
SD 2.55). The two groups do not differ sig- 
nificantly on mean age and education. 

The 50 normal subjects were residents of 
a small midwestern community ° located in 
the same geographical locale from which the 
neurotics came. They were comparable in age 
(mean age 35.62, SD 7.24) and the mean 

< education of the neurotics suggests as well 
that the normals are probably similar in this 
respect based on average education expect- 
ancy. 

All tests were individually administered. 
The Rorschach scoring of the original ex- 
aminer was accepted for all of the normal 
cases as the protocols had been scored ac- 
cording to the Beck system (1) and checked 
by a second person. In the cases of the pa- 
tients where the Rorschach protocols had not 
been scored according to Beck or where the 
records had been scored by psychology 
trainees, identification was removed from the 


2? The records were taken from a larger study done 
under the supervision of Marshall R. Jones and sup- 


Ported by the University of Nebraska Research 
Council. 
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Table 2 


Comparison of Normal, Continuer, and Attriter Groups on Mean Scores for Certain Rorschach Variables 


Normal Continuer Attriter 
(N = 50) (N = 45) (N = 40) 
Rorschach 
variable Mean SD Mean SD Mean SD 

#R 24.52 12.78 24.84** 11.69 15.40** 7.72 
F% 62.16 15.08 63.98 16.41 69.50 19.85 
AN 49.98 14.74 46.20** 15.97 58.60** 17.18 
# Rejections 40 1.00 49* 1,22 125* 1.51 
#S 1.38 1.66 1.51* 1.60 .85* 1.24 
#C 450 3.22 4.13** 301 1.98 — 2.43 
#Y 3.04 2.65 2.53* 2.40 1.60* 2.22 
ay “80 1.31 96% 115 208 T40 
#An 2.20 2.26 2.67** 2.71 -98** 1.65 


* Continuers and attriters significantly different at .05 level (one-tailed tests), 
#* Continuers and attriters significantly different at .01 level (one-tailed tests). 


records and they were rescored by the author. 
In order to eliminate some of the unreliabil- 
ity of scoring of the Rorschach variables be- 
ing investigated, no attempt was made in 
stating the hypotheses to differentiate be- 
tween the responses determined primarily and 
secondarily by the form element. There was 
simply a count of the responses in which the 
particular determinant was present. 


Results 


Hypothesis 1. Symptoms and affects. The 
results support the hypothesis that the con- 
tinuers show a greater elevation of the symp- 
tom scales (Hs, D, Pa, Pt, and Sc) of the 
MMPI than the attriters. These differences 
were all significant at the .05 level or less 
except for the Hs scale which was in the pre- 
dicted direction. The means and standard 


deviations of the MMPI scales for the two 
groups are reported in Table 1. 

As predicted, the continuers gave more CG, 
Y, V, and An responses, and a large number 
of cases gave responses falling in these cate- 
gories. The mean differences between the two 
groups on the number of responses for each 
variable are all significant at the .05 level or 
less as shown in Table 2. Significantly more 
continuers gave C, F, V, and An responses 
than did the attriters. The number and per- 
centage of individuals in each group who 
gave these responses, and the chi-square tests 
of differences are reported in Table 3. 

Hypothesis 2. Defensiveness. The continu- 
ers rejected significantly fewer cards, and 

- significantly fewer continuers rejected cards, 
and gave a lower A%. The F% was lower in 
the continuers but not Significantly so (see 
Tables 2 and 3). 


Table 3 


Comparison of Number and Percentage of Subjects in Normal, Continuer, and Attriter Groups 
Giving Certain Types of Rorschach Responses 


Normal Continuer Attriter Continuer ys. Attriter 
Rorschach 

variable No. © % No. % No. % xt b 
Rejecting card(s) 9 (18%) 8 (18%) 22 (55%) 12.8. 
s 31 (62%) 30 (67%) 19 (48%) a1) ‘10, 
c 46 (92%) 41 (91%) 28 (70%) 4.73 05 
Y 44 (88%) 34 (76%) 22 (55%) 3.98 05 
y 21 (42%) 24 (53%) 8 (20%) 10.02 01 
ja 38 (76%) 33 (73%) 15 (38%) “YG 001 


Earl S. Taulbee 


Table 4 
Frequency and Assigned Weights of Prognostic Signs Occurring in the Continuer and Attriter Groups 


Continuers Attriters 
Prognostic 
sign Present Absent Present Absent a p Weight 
Hy > Pt 24 19 28 10 2.80 10 1 
Hy > Sc 29 15 33 6 3.83 -10 1 
Pd > Pa 20 24 30 10 7.59 01 3 
På > Pt 9 35 19 20 7.39 .01 3 
Pd > Sc 8 36 22 16 13.86 001 4 
Ma> Pa 15 28 20 17 2.97 10 1 
Ma> Pt F 37 14 26 4.07 05 2 
Ma > Sc 6 38 16 22 8.42 01 3 
Rs15 9 36 21 19 9.79 01 3 
A% = 58 8 37 23 17 14.42 001 4 
Rejections S 1 8 31 22 18 12.85 001 4 
S% <2 15 30 22 18 4.04 .05 2 
C% <6 5 40 18 22 10.48 01 3 
Y% <3 12 33 18 22 3.12 10 1 
V% <2 21 24 33 7 11.74 001 4 
Anh = 12 33 25 15 11.06 001 4 
Hypothesis 3. Persistence. The continuers centage score for each variable. The chi 


Save significantly more S responses and a 
greater number of total responses (R). The 
difference between the number of continuers 
and attriters giving S responses is significant 
at almost the .05 level. 
_ Hypothesis 4. The continuers were more 
like the normal subjects on each of the vari- 
ables predicted than they were like the at- 
triters. As was expected, the two former 
groups tended to differ from each other with 
respect to the importance of the “form” ele- 
ment in the responses (e.g., the 
gave more FC and fewer CF an 
than did the continuers, simil 
other variables). 

The continuers gave a significantly larger 
number of total responses than did the at- 
triters; therefore chi squares were computed 
between the two groups on S, C, Y, V, and 
An responses corrected for R. The method of 
correction was that suggested by Cronbach 
(3, p. 411). Each variable was plotted against 
R for the combined groups, and the median 
was used as the dividing point. Then the 
number of cases in each group falling above 
and below the median were compared by chi 
square. The results were all significant at the 
05 level or better. In addition, the same 
method of correction was applied to the per- 


normal group 
d C responses 
arly with the 


© 


squares were all significant at less than the 
.01 level except for S% and Y% which did 
not reach the .05 level. 

In the interest of the practical significance 
of the variables for prognostic purposes, a 
cutoff point for each and for the variables 
combined was sought which would afford the 
maximum differentiation effectiveness of the 
measures. Therefore, an objective configural 
analysis, which has been described in detail 
elsewhere (7, 8), was applied to the MMPI 
profiles of the subjects and there were eight 
scale pairs which differentiated the two 
groups at the .10 level or less. Then the best 
cutoff point for separating the continuers and 
attriters on the basis of the percentage score 
for each Rorschach variable was determined. 
The resulting prognostic signs (eight MMPI 
scale pairs and eight Rorschach variables), 
frequency and significance level of occurrence 
of each, and arbitrary weights assigned for 
prognostic purposes are shown in Table 4. 
A combined prognostic score was determined 
for each patient by summing the weights of 
the signs present. These prognostic scores for 
the 85 patients were arranged in a frequency 
distribution and the most effective upper and 
lower cutoff points determined. An interval 
tabulation of the frequency of prognostic 
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scores occurring in the two groups is shown 
in Table 5. The upper (19-43) and lower 
(0-10) ranges represent the most effective 
cutoff points for differentiating the attriters 
and continuers, respectively. 

In previous unpublished research on the 
outcome of psychotherapy, the author ob- 
tained therapists’ ratings of improvement on 
56 of the cases used in the present study (21 
attriters and 35 continuers). These cases were 
divided into two groups, one group contain- 
ing those who showed limited or no improve- 
ment (all the attriters and 20 or 57% of the 
continuers) and the other group comprised of 
those showing moderate or extensive improve- 
ment (15 or 43% of the continuers). Herein- 
after these will be referred to as the “limited 
improvement” and “moderate improvement” 
groups. A comparison of these two groups 
on mean MMPI profiles and Rorschach vari- 
ables mentioned above reveals relationships 
between these scores and improvement simi- 
lar to those found between these scores and 
continuation in treatment. The only excep- 
tion was that the limited improvement group 
had a higher Hs score than did the moderate 
improvement group (the Hs was not signifi- 
cantly higher in the continuers than in the 
attriters). Patients in the moderate improve- 
ment group tended to have higher scores on 
D, Mf, Pa, Pt, and Sc, and to have a greater 
number of C, Y, V, and Am responses, a 
larger R, and a lower number of rejections 
and A%. Tests of significance were not com- 
puted between the groups because of the small 
number of subjects in the moderately im- 
proved group and the crude rating scale used. 
The writer is well aware of the likelihood of 
contamination in the judgments of the thera- 
pists in that the ratings of improvement may 
have been influenced by the length of time 
the patients remained in treatment. A partial 
check on this was made by comparing the 
limited improvement and the moderate im- 
provement cases of the continuer group orly. 
The results reveal a tendency for most of the 
variables to be related in the predicted direc- 
tion to improvement. However, these data 
from the unpublished research should be con- 
sidered only as suggesting a relationship be- 
tween the personality variables studied and 
improvement in psychotherapy. 


Discussion 


The results of this study offer support for 
the hypothesis that there are identifiable per- 
sonality variables which are associated with 
the premature termination of, or continua- 
tion in, individual therapy. Also, there is evi- 
dence to suggest that all or most of these vari- 
ables are related to degree of improvement as 
rated by therapists. Because of the very ho- 
mogeneous nature of the patients used in this 
study, the strength and number of variables 
identified are probably minimal. It is expected 
that with diagnostically more heterogeneous 
groups, such as those used by Cartwright and 
Taylor, these differences would be more pro- 
nounced and other pertinent attributes could 
be identified. 

The author interprets the data to indicate 
that those patients who stay in treatment 
longer, and who are likely to show greater 
improvement, are considerably more respon- 
sive emotionally to their perceived world than 
are those who drop out prematurely. They are 
sensitive to a wider range of affective stimuli, 
including both those of a more pleasurable 
and painful nature. The continuers are more 
anxious, sensitive, dependent, self-doubting, 
and have increased awareness of feelings of 
inadequacy, inferiority, and depression. They 
possess better potential for self-appraisal, af- 
fective reactivity and have more of a compul- 
sive introspective attitude. The greater need 
of the continuers to be accepted and to re- 
ceive affection is probably a motivating fac- 
tor in the increased interaction with others. 
However, these interactions are in many ways 
immature. The continuers’ stronger feminine 
interests, or less adequate identification with 
the cultural norms of masculinity, and greater 


Table 5 
Frequency and Percentage of Prognostic Scores Occur- 


ring in the Continuer and Attriter Groups 
and Differences Between Groups 


Prognostic 
score Continuers  Attriters x? p 
19-43 4 (9%) 29 (73%) 33.15 <.001 
11-18 16 (36%) 10 (25%) 
0-10 25 (56%) 1 (3%) 25.35  <.001 
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preoccupation with anatomy may be indica- 
tive of more disturbance in the sexual area. 
The attriters’ not scoring significantly lower 
on the Hs scale as they did on Mf and An 
would be consistent with this view. Many 
clinicians consider An responses to be a screen 
for things more directly sexual in nature. 
There is also a greater tendency for the con- 
tinuers to be more moody, to nurse grudges, 
and to be basically more hostile. 

The repressive defense of the continuers is 
failing and, instead of a strengthening of this 
mechanism as occurs in the attriters, they 
are drawing upon other defenses, particularly 
projection, phobic and obsessive ideation, or 
compulsive behavior. The test pattern of the 
continuers is much more like that usually 
considered to be characteristic of patients 
whose primary symptoms are of a conversion 
or somatization nature than is the attriters’. 
Approximately 60% of both the attriters and 
continuers on whom the information was 
available were diagnosed anxiety reactions 
and about 35% of both groups were classi- 
fied as conversion reactions. The continuers 
have an immature attitude toward life, are 
poorly controlled emotionally, have fear and 
guilt related to their sexual functioning, and 
pay a great deal of attention to anatom: 
Their primary defense of re i $ 

! r pression, along 
with their tendency to convert emotional con- 
flict into motor or sensory channels, has not 
been effective in alleviating the underlying 
anxiety; therefore, other defenses have been 
resorted to but to a lesser degree. 

In contrast to the continuers, the attriters 
emphasize intellectual control and handle 
situations in an impersonal, matter-of-fact 
way. Repression has generalized to the point 
that they are able to acknowledge or respond 
to a very limited range of emotional stimula- 
tion; consequently, both their social interac- 
tion and thought processes have become very 
stereotyped and barren. The attriters’ relative 
absence of emotional lability and consciously 
felt anxiety, plus a greater withdrawal and a 
more intellectual approach to their problems, 
suggest that their repressive and narcissistic 
defenses and symptoms are working suffi- 
ciently well to enable them to adjust without 
continued treatment, at least temporarily. 

Quantitatively, the continuers and normals 
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are very similar on the Rorschach variables 
investigated. However, a qualitative inspec- 
tion of the data reveals that the continuers 
are less well integrated and manifest a more 
immature responsiveness. 

These findings are consistent with the gen- 
erally accepted indicators of better risks for 
therapy and with the results of the studies 
mentioned. There is much to suggest that 
feelings of anxiety, inadequacy, depression, 
dependency, and the potential for self-evalua- 
tion and affective responsiveness are signs of 
strength within the personality. While the 
continuers tend to have more vague somatic 
symptoms, an inspection of the improvement 
ratings reveals that there is less improvement 
in those patients who are extremely preoc- 
cupied with hypochondriacal complaints. The 
exaggerated physical concern would appear 
to be a defense against accepting the psycho- 
genic etiology of their symptoms. 


Summary 


This study investigated the hypothesis that 
there are certain identifiable personality vari- 
ables which are related to therapy prognosis. 
A group of neurotics who remained in treat- 
ment for 13 or more interviews and a group 
who terminated prior to the 13th interview 
were compared on the basis of certain Ror- 
schach scoring categories and MMPI scales. 
Both of these groups were compared to a 
group of normal subjects on the Rorschach 
variables. As predicted, the continuers were 
less defensive, and more persistent, anxious, 
sensitive, and dependent than the attriters. 
They possessed an increased consciousness of 
feelings of inadequacy, inferiority, and de- 
pression and had better potential for self-ap- 
praisal, emotional responsiveness, and more 
of an introspective attitude. There is evidence 
to suggest that these personality variables are 
associated with improvement as well as with 
continuation in therapy. The continuers re- 
sembled the normals more than they did the 
attriters on the Rorschach measures. The re- 
sults support the contention that painful af- 
fects which the neurotic experiences are signs 
of strength within the personality. 

Prognostic scores are suggested for differ- 
entiating the continuers from the attriters. 


of 
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However, the scores have not been cross- 
validated and should be used very cautiously. 
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A Case of Folie a Deux and Projective Techniques 


Edward M. Scott 


Eastern Oregon State Hospital 


Folie a Deux is mentioned only briefly in 
the literature. Psychological testing has been 
reported in but two articles. Another case on 
such an intriguing topic should be of some 
interest. 

Recently committeed to the Eastern Oregon 
State Hospital were two 50-year-old, prob- 
ably identical, twin brothers. They had never 
married and had a “spotty” work record. The 
hospital staff diagnosed them as paranoid 
schizophrenics, with folie a deux condition. 
“A,” the dominant twin, became psychotic 
and influenced “B” into the same condition. 
A brief summary of the psychological battery 
is given: 

On the Wechsler-Bellevue Intelligence Scale: 


“ay «Rr 
Verbal Scale IQ 105 105 


Performance Scale IQ 99 94 
Full Scale 1Q 103 100 


On the Rorschach, “A” gave 13 responses, 
with 11 F-responses, and 11 perceptions that 
were sexual in nature. “B” gave 21 responses, 
with 7 F-responses and 7 that were sexual in 
content. Many of their perceptions appeared 
to be fundamentally of the same psychopatho- 
logical nature. For example, on Card 9, “A” 
said, “Nasty looking. Part of a woman. May- 
be the lower part”; while “B” said, “Oh! Un- 


clean. Just the upper part. Most women are 
in the lower part.” 


Their TAT responses appeared to show 
similar dynamic trends. It is difficult to show 
a typical theme; perhaps Card 14 is signifi- 
cant. “A” responded, “Somebody looking out 
the window. Ooh! Terrible. Outside is free- 
dom. That’s a lot better. Somebody penned 
him up. He hurt the world. Gave it a dis- 
ease.” “B” responded to the same card, “Ooh! 
Must be waiting for somebody, all alone. Re- 
morse, guilty, committed murder or killing. 
Maybe his past life caused him to do that. 
He'll have to pay. Probably go mad.” 

“A” earned a higher score, 92, than “B’s” 
81 on the Bender-Gestalt. 

The projective tests indicated that “A” was 
more deteriorated yet a bit more intellectual. 
Using Grover’s (2) and Gralnick’s (1) divi- 
sion of folie a deux, this case appears to be 
one of folie impasse, although some might 
hold to folie communique. Both patients re- 
sponded to electroshock therapy and were dis- 
charged shortly thereafter. 

Psychological testing seems to be of defi- 
nite value in folie a deux. 
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The Prognostic Significance of Certain 
Behavioral Variables 


A. Eskey and Ira Friedman 


Cleveland Receiving Hospital and State Institute of Psychiatry 


In a previous study (3) it was reported that 
disoriented mental patients do not improve 
more rapidly than oriented patients. This runs 
contrary to the expectation that severe symp- 
toms reflecting personality disorganization are 
often more refractory than are milder overt 
symptoms. The authors suggest that disori- 
entation may not be “sufficiently representa- 
tive of ‘acute onset . . . confusion and atypi- 
cal symptoms’ (1) to yield consistent results 
in the anticipated direction.” It was suggested 
that other variables be investigated which 
might be considered more reflective of this 
symptom picture. The present study is an ap- 
proach to this problem. Specifically, it repre- 
sents an attempt to investigate the relation- 
ship of verbal activity, motor activity, and 
quality of thinking to length of hospitaliza- 
tion in order to evaluate whether these vari- 
ables are related to rapidity of improvement. 


Method 


Two hundred randomly selected psychotic 
patients, male and female, between the ages 
of 16 and 59 were included in the study. This 
group exhibited a wide range of motor and 
verbal activity as well as varying degrees of 
intactness and disorganization of thought 
processes. The following criteria were used to 
exclude patients from the study: those who 
remained in the hospital for less than two 
weeks, those with any type of organic brain 
damage, alcoholics, mental defectives, chronic 
patients transferred to “custodial” institu- 
tions, those discharged as unimproved, pa- 
tients leaving against medical advice, cases 
where language difficulties made communica- 
tion unreliable, and patients who were under 
heavy sedation. 
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Each patient was rated on motor activity, 
verbal activity, and quality of thinking. These 
ratings were based upon information derived 
from mental status examinations obtained on 
each patient at the time of hospital admis- 
sion. Motor and verbal activity were rated on 
a nine-point scale which ranged from under- 
activity to overactivity (two-tailed) while 
thinking was rated on a five-point scale rang- 
ing from intact to disorganized thinking (one- 
tailed). The scales are presented in Table 1. 

Since one of the Es was the sole rater in 
the experiment proper, a reliability study was 
undertaken in order to ascertain whether other 
judges could reliably estimate motor activity, 
verbal activity, and quality of thinking from 
a report of a mental status examination. Ten 
randomly selected patients were rated by five 
judges, including Æ. The reliability of the av- 
erage ratings computed by Ebel’s (2) appli- 
cation of the Spearman-Brown formula to the 
formula for the reliability of individual rat- 
ings set forth by Snedecor (5), yields the fol- 
lowing reliability coefficients: motor activity 
r= .98, verbal activity r = .98, and quality 
of thinking r = .96. 

Since all the patients included in the study 
were discharged as improved or recovered, the 
prognostic significance of the variables were 
derived from relating them to length of hos- 
pitalization. From an operational point of 
view then, prognosis refers to the rapidity of 
improvement or recovery rather than to de- 
gree or quality of improvement. Comparisons 
were made between groups showing high, low, 
and normal verbal and motor activity, as well 
as those displaying intact, as opposed to dis- 
torted or disorganized, thought processes in 
terms of length of hospitalization. The ¢ test, 


92 A. Eskey and Ira Friedman 


Table 1 
Scales for Verbal Activity, Motor Activity, and Quality of Thinking 
Scale Mar 
Value Criterion 
Verbal Activity Scale 

9 Patient is extremely circumstantial; talks almost constantly. Little or no pause in his conversation. Minimal 
(or no) attention paid to examiner's questions (or presence). "NE letodirect 

8 Patient is definitely overtalkative. Noticeable “push” behind speech but examiner is still largely able to direc 
the course of the interview. i ù 

7 Speech is noticeably more “loose” than normal, Some evidence of circumstantiality. 

6 Patient is slightly overtalkative, may be mildly expansive. i 

5 Normal flow of speech. Patient enters freely into discussion with the examiner. 

4 Speech is mildly inhibited but no real constriction is present. Speech is still largely spontaneous. 

3 Patient does not communicate freely; some blocking may be noted. May answer examiner's questions reluc- 
tantly or tangentially. ` i 

2 Speech is definitely constricted but communication still takes place. Patient may be "holding back" relevant 
information. Little attempt to initiate or maintain conversation. y 

1 Minimal (or no) communication. Speech highly constricted; no pertinent information is elicited. May be mute. 

Motor Activity Scale 

9 Patient is hyperactive, restless, and unable to sit still. In constant or near constant movement. May be in 
restraints. 

8 Definite signs of excitement are present, Patient is clearly overactive but still able to exert some control over 
his activity, P 

7 Mild signs of agitation are present, Patient is more than normally active but in no respect exhibits a real loss 
of control, ae 

6 Patient may be slightly restless or fidgety, e.g., tapping his foot, drumming fingers, shifting uneasily in his 
chair, etc. 

5 Normal degree of motor activity, No evidence of retardation or agitation. k 

4 Patient may appear to be slightly listless or lacking in energy but is not actually retarded nor apathetic, 

3 


A noticeable degree of 


exhibits some freedom of movement, 
2 Physical movements are de 
1 


Little or no physical move: 


apathy or retardation is present. General motor activity is reduced but patient still 


i a 1. 
finitely retarded, Movements are slow and effortful. s 
ment is a ees is quiet or sits stiffly in chair. May be rigid. 


Quality of Thinking Scale 


inor deviations from orderly thinking noted, No gross misinterpretation of reality is present. Some fluidity 


Definite evidence of disturbed thinking, Logical inconsistencies are apparent. Delusional ideas and/or halluci- 
fpations may be present. There may be some doubt that his experiences are based on reality. 
eal; 


i i salir ical 
nein tins is obviously impaired but patient still has some contact with reality, Kemnantg oe 
cae are still present but in general the patient ignores or is unaware of logical inconsistencies. 
and/o) 


7 Thought processes appear to be intact, No evidence of illogical or distorted thinking. 
M: 
a or looseness of thinking may be noted, 
4 
r hallucinati ent and are 
5 Patient exhib; ee 


accepted without question by the patient. 


its extremely confused and bizarre thinking. Little or no appreciation of sane a ge 
Thoughts are so fragmented, or communication is so scant as to make more exact estimation of the degree 
of control impossible, 


utilizing medians, was employed to calculate 
the significance of the differences, 


Results 


Each patient was rated for motor activity, 
verbal activity, and thinking in accordance 
with the descriptive statements of the scales 
in Table 1. The distribution of the patient 
population on the various scale categories is 
indicated in Table 2. 

The patients were grouped on verbal and 
motor activity in terms of overactivity (high, 
rated 7, 8, or 9), underactivity (low, rated 1, 
2, or 3), and normal activity (middle, rated 
4, 5, or 6). These groups, differing in degree 
of activity, were compared with one another 


to ascertain the significance of the differences 
in length of hospitalization. The extremely ac- 
tive (group rated 9, and groups rated 9 and 
8 combined) and the extremely underactive 
(group rated 1, and groups rated 1 and 2 
combined) were also compared with one an- 
other and with the prototypic normally active 
group (those rated 5). The ¢ test was used to 
test for the significance of the differences in 
length of hospitalization and the results are 
presented in Table 3. 

In reference to thinking, the same pro- 
cedure was followed but somewhat different 
groups were combined because the scale 3 
one-tailed rather than two. In this case, dif- 
ferences in length of hospitalization were com- 
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Table 2 


Frequency Distribution of Patients on the Three Scales 


Scale Value 
Scale 1 2 3 4 5 6 F 8 9 
Motor activity 8 7 13 18 66 28 19 18 23 200 
Speech activity 9 25. 34 7 47 9 1255 3a) nae 200 
Thinking 4 9 46 76 65 — = = as 200 


puted only for those groups rated 1 and 2 as 
compared to those rated 3, 4, and 5 combined 
and to those rated 5 alone. Because the NV is 
so small in the combined group rated 1 and 
2, a comparison was made between 1, 2, and 
3 as contrasted to 4 and 5. These results are 
also presented in Table 3. 

The results summarized in Table 3 reveal 
that, in the areas of motor and verbal ac- 
tivity, there are no significant differences in 
length of hospitalization. This holds true when 
comparing normally active with both overac- 
tive and underactive and when comparing ex- 
tremes of activity with one another, An addi- 
tional check was made in the area of motor 
activity by selecting those patients who were 
placed in restraints and comparing them with 
an equal number of randomly selected pa- 
tients displaying a normal degree of motor 
activity. In this comparison, the two groups 
(N = 38) did not differ significantly in terms 
of median length of hospitalization (¢ = .19, 


= .85). These results indicate that neither 
motor nor verbal activity are valid prognostic 
indicators of rapidity of improvement. 

From Table 3 it may also be observed that 
significant differences are obtained when com- 
paring patients who reveal normal or rela- 
tively normal thinking with those who dis- 
play distorted or disorganized thinking. These 
differences are not in the anticipated direc- 
tion, however, and it appears that those pa- 
tients who have little or no disturbance of 
thought processes are more likely to be dis- 
charged sooner, Unfortunately, the number of 
cases displaying adequacy of thought proc- 
esses is small ( = 13) so that the general- 
ity of conclusion is limited. When the group 
rated three on thinking, i.e., somewhat patho- 
logical, was included along with those with 
more normal thinking processes and compared 
with patients displaying greater thought pa- 
thology, the results failed to reach acceptable 
levels of significance. However, even here, a 


Table 3 
Significance of Differences in Length of Hospitalization Between Groups Differing in Scale Ratings 


Scale Ratings Verbal Activity Motor Activity Quality of Thinking 
of Comparison 
Groups t $ t $ < t t 
123-789 46 64 97 33 — a 
123-456 ` 40 .70 56 58 — = 
456-789 790) 38 62 54 af 
12-89 23 82 1.27 .20 -A a 
12-5 ‘55 58 46 65 2.15 04 
5-89 36 72 34 73 a 08 
19 20 84 10 92 a r 
1-5 44 64 04 97 — jel 
5-9 29 7 AS 66 = at 
12-345 — = z = 230%) 102 
123-45 = = re = 143 a5 
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tendency for more rapid discharge of patients 
whose thinking was more intact upon admis- 
sion was noted. 

As a final check on the data, the upper 
quarter of each group was compared with the 
lower quarter by means of the Mann-Whitney 
U test (4). In this comparison, only thinking 
proved significant (p = .02), whereas motor 
activity (p = .33) and verbal activity (p 
= .23) proved nonsignificant as in the pre- 
vious tests. This nonparametric technique was 
used not only because of nonnormal distribu- 
tion of the data, but also to give more appro- 
priate weight to extreme scores which tend to 
be underweighted with medians and over- 
weighted using means. 


Discussion 


Overactivity and underactivity in verbal 
and motor behavior and a greater disorgani- 
zation of thought processes do not appear to 
be associated with more rapid improvement 
as measured by length of hospitalization. 
In the area of thinking, as a matter of fact 
the less the disorganization of thou i 
esses at the time of admi 
is the tendency for more rapid discharge. 
These findings shed doubt upon the generali- 
zation that more extreme symptomatology re- 
sponds more rapidly to treatment. 

Ina Previous article (3), the authors re- 
lated the impression that severe symptoma- 
tology is more refractory than milder overt 
symptomatology to Gestalt memory principles 
of similarity and contrast, i.e., that we tend to 
recall those patients whose final state differs 
markedly from their condition upon admission. 
The present study suggests that improvement, 
sufficient to warrant discharge, is nondifferen- 
tial between patients displaying extreme or 
mild symptomatology in temporal terms. It is 
important to point out clearly, however, that 
no attempts were made to examine the qualita- 
tive degree of improvement. Since all patients 
were discharged as improved, we might hy- 
pothesize that attempts to measure qualita- 
tive changes between condition upon admis- 
sion and at discharge would yield greater 
change in those patients who initially dis- 
played more deviant behavior. We do not 


i ght proc- 
ssion the greater 
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know, however, whether the discharge condi- 
tion of patients differing upon admission in 
terms of severity of symptomatology would 
yield differences in terms of some absolute 
criteria of “normality.” It appears that the 
evaluation of the degree and nature of quali- 
tative change, and the comparison of dis- 
charge condition to some absolute criteria of 
“normality” is a fruitful area for further re- 
search to shed more light on this problem. 
Replication of the present study and further 
studies investigating other symptom pictures 
are also necessary. 


Summary 


Two hundred psychotic patients discharged 
as improved were rated on verbal activity, 
motor activity, and quality of thinking dis- 
played at the time of hospital admission. 
Comparisons were made to determine whether 
differences in degree of overt symptomatology 
were associated with rapidity of improvement 
as measured by length of hospitalization. The 
results indicate that degree of activity is not 
associated with rapidity of improvement but 
that patients with more intact thought proc- 
esses at the time of admission tend to be dis- 
charged more rapidly. The findings shed doubt 
upon the generalization that more extreme 
symptomatology responds more rapidly to 
treatment. Differences in viewing improve- 
ment in temporal and qualitative terms were 
discussed in reference to suggestions for fur- 
ther research. 
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Self Acceptance and Marital Happiness’ 


Daniel Eastman 


Teachers College, Columbia University 


Previous researches on the personality cor- 
relates of marital happiness or adjustment 
have tended to rely on heterogenous and ec- 
lectic personality measures of limited theo- 
retical and clinical significance (2, 3, 6, 7, 
12). In the present study, self acceptance 
was chosen as a personality measure for in- 
vestigation because it is a relatively homog- 
enous variable based on a developed theory 
of personality with explicit clinical implica- 
tions (8, 9, 10, 11, 15). A 

Reduced to its simplest terms, the experi- 
ment consisted in scoring a sample of mar- 
ried couples on two questionnaires, one for 
marital happiness (MH) and one for self ac- 
ceptance, and correlating the two sets of 
scores. This simple scheme was complicated 
by further investigating: (a) the relation of 
MH to the additional personality variables, 
acceptance of others and psychological status; 
(b) the relation of MH to all the personality 
variables in the subjects’ mates as well as in 
the subjects; (c) the relation of MH to the 
mates’ MH, that is, the role of mutual hap- 
piness; and finally, (d) the effect of sex dif- 
ferences on the correlations between MH and 
the personality variables. 


Method 


Marital happiness was measured with the 
instrument constructed by Wallace (14), in 
essence a compilation of the most discriminat- 


1This paper is based upon a dissertation sub- 
mitted to the Department of Family Life, Teachers 
College, Columbia University, in partial fulfilment of 
the requirements for the degree of doctor of philoso- 
phy; committee members, Ernest G. Osborne, chair- 
man; Arthur T. Jersild and Laurance F. Shaffer. 
The original report (4) may be consulted for more 
detailed treatment of the rationale, methods, and 
results. 


ing items in the Terman (12) and Burgess 
and Cottrell (2) questionnaires. 

Self acceptance (s) was measured as the 
discrepancy between Ss’ ratings of self and 
self ideal, using an abbreviated form of the 
rating scales developed by Bills, Vance, and 
McLean (1). Acceptance of men (m) and of 
women (w) was measured on the same scales 
as the discrepancy between ratings of men and 
women in general, and self ideal; acceptance 
of others (o) being then taken as the mean of 
acceptance of men plus acceptance of women 
(m/2 + w/2). The variable called psychologi- 
cal status was calculated as the signed differ- 
ence between acceptance of men, women, or 
others, and self acceptance (m-s, W-s, or o-s). 
Psychological status corresponded to what are 
sometimes called feelings of superiority or in- 
feriority. 

Ss were gathered in groups of five or more 
couples brought together by colleagues osten- 
sibly for social purposes. All couples in every 
group agreed to fill out the questionnaires. In 
order to encourage frankness, the question- 
naires were anonymous, and couples were 
separated before filling them out. Each couple 
was required to put its completed question- 
naires in the same manila envelope before re- 
turning them, so that the investigator was 
able to determine married pairs, while pre- 
serving anonymity and interspouse secrecy. 
When some eight spoiled blanks were elimi- 
nated, the sample consisted of 50 couples 
married two years or more, and 14 couples 
married less than two years. 


Results 


Table 1 shows the means and standard de- 
viations of all the variables for the sample of 
50 couples married more than two years. The 
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Table 1 


Marital Happiness and All Variables, by Sexes, for 
50 Couples Married More Than Two Years 
(Means and standard deviations) 


Husbands Wives 
(N = 50) (N = 50) 
Variable Mean SD Mean SD 
Marital happiness 108.4 25.49 112.6 27.15 
Self acceptance 36.2 15.97 36.4 14.66 
Acceptance of men 46.8 10.97 45.0 14.90 
Accept. of women 51.7 10.00 51.1 16.50 
Status re men 10.6 15.90 8.6 17.60 
Status re women 15.5 14.53 14.7 17.69 


split-half reliabilities corrected by the Spear- 
man-Brown formula were: for self accept- 
ance, .89; for acceptance of men, .82; for 
acceptance of women, .90. Wallace reported 
a corrected reliability of .90 for his test of 
marital happiness, 

The means for all the variables reported 
here were not significantly different from 
those obtained in other investigations with 
the same questionnaires in clinically “normal” 
groups (4). 

The chief point to be noted in Table 1 is 
the complete lack of any significant difference 
m means between the husbands and wives in 
the sample on any of the variables measured. 
This lack of mean difference between sex 
groups was confirmed in another sample not 
reported here (4). Under these circumstances 
any observed difference in : 


the marital per- 
formance of the two sex groups could not be 


explained on the basis of different average en- 
dowments of the two sexes, 

It may be noted that both husbands and 
wives scored women in general significantly 
less acceptable than men in general, a bias 
also confirmed for both sex groups in another 
sample not reported here (4). Statistical tests 
in the further course of the investigation 
showed this bias to have no significant cor- 
relation with marital happiness in either hus- 
bands or wives or their mates. 


Marital Happiness and Self Acceptance 


Table 2 shows all the zero-order correla- 
tions between MH and self acceptance. MH 


was significantly related to self acceptance 
both in the Ss themselves and in their mates. 
If sex groupings were combined, the correla- 
tion between MH and the Ss’ own self ac- 
ceptance was significant at the .0005 level 
and between MH and mates’ self acceptance 
at the .0001 level. 

The correlation between the husbands’ MH 
and their wives’ self acceptance was the high- 
est obtained for self acceptance in a single 
mate. This higher correlation was probably 
not the result of accident. In the sample of 
14 couples married less than two years, the 
correlation between husbands’ MH and wives’ 
self acceptance was .53, the only significant 
correlation with self acceptance obtained in 
that small sample. 

The correlation of MH with the summed 
self acceptance of both mates was consider- 
ably higher than the correlation with either 
mates’ self acceptance alone, in part because 
the mates’ self acceptance scores were largely 
independent of each other (r = .24). About 
twenty-five per cent of the variance in MH 
was accounted for by the summed self accept- 
ance of both mates; a figure that compares 
favorably with the percentage of MH ac- 
counted for by any other single variable, or 
any other combination of variables, previously 
investigated. It should be pointed out, how- 
ever, that the variables employed in previous 
investigations were not summed for both 
mates, since the investigators either did not, 
or could not, obtain a significant correlation 
between MH and mates’ scores on the vari- 
ables employed. 


Table 2 


Correlation of Marital Happiness with Subjects’ and 
Mates’ Self Acceptance, by Sexes, for 50 Couples 
Married More Than Two Years 


Husbands Wives 
(N = 50) (N = 50) 
Marital Happiness 
Correlated with— r $ PTE 
Self acceptance .37 005 .35 01 
Mates’ self acceptance .47 0005 .35 01 
Self acceptance of both 
mates 53.0005 44 005 


a 
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Table 3 


Correlation of Marital Happiness with Other Variables, 
by Sexes, for 50 Couples Married More 
Than Two Years 


Husbands Wives 
(N = 50) (N = 50) 
Marital Happiness § ————— 
Correlated with— r $ r $ 
Acceptance of 
Men .01 = .26 .05 
Women 12 = 32 025 
Others 07 = 32 .025 
Status re 
Men 36 .005 07 — 
Women 32 .025 —.01 — 
Others .36 .005 .05 — 


Note.—The score for acceptance of others was the mean of 
the scores for acceptance of men plus acceptance of women. 


Marital Happiness and the Other Variables 


Table 3 shows the correlations between MH 
and the Ss’ own scores for acceptance of others 
and for psychological status; Table 4 shows 
the correlations between MH and the mates 
scores for acceptance of others and psycho- 
logical status. 

It will be seen that the MH of both hus- 
bands and wives correlated significantly with 
the wives’ acceptance of others, but not with 
the husbands’ acceptance of others; and that 
the MH of both husbands and wives corre- 
lated significantly with the husbands’ psy- 
chological status but not with the wives’ psy- 
chological status. Acceptance of others was 
maritally operative only in the wives, psy- 
chological status only in the husbands. 

In view of the double check afforded by 
separate scores for acceptance of men (m) 
and acceptance of women (w), and of the fur- 
ther double check afforded by cross validation 
between Ss and mates, it seems fairly safe to 
suppose that the sex pattern revealed in these 
correlations exists in the population of couples 
married more than two years. 


Marital Happiness and Mutual Happiness 


The correlation between the MH scores of 
the husbands and their wives was 74 for the 
50 couples in the present sample. This figure 


appears to indicate a considerable- dependence 
of MH on mates’ marital happiness, that is, 
a high degree of mutuality in MH. ; 

However, the figure .74 was unreliable be- 
cause the MH test itself is partly composed 
of items that deal with objective facts, such 
as the amount of disagreement between the 
mates. The correlation may therefore have 
represented in part nothing more than the 
tendency of the mates to see objective facts 
about their marriage in the same way. Never- 
theless the positive correlation between the 
MH scores of the mates obtained in this 
study, and in every other study using similar 
instruments, probably does indicate some real 
interdependence of MH, that is, real mutual- 
ity, as Terman supposes (12, pp. 80-83). 

In Table 5, partial correlations are shown 
between MH and self acceptance where mates’ 
MH was held constant, that is, where all the 
mutuality, whatever its unknown size, was 
eliminated statistically. It may be seen in the 
first row of the table that under these condi- 
tions MH showed no significant correlation 
with Ss’ own self acceptance in either sex 
group, in contrast to the highly significant cor- 
relations obtained earlier when mutuality was 
not eliminated. 

Apparently, Ss’ own self acceptance is re- 
lated only to that portion of MH which is 


Table 4 


Correlation of Marital Happiness with Mates’ Scores 
on Other Variables, by Sexes, for 50 Couples 
Married More Than Two Years 


Husbands Wives 
(N = 50) (N = 50) 
Marital Happiness 
Correlated with— r È r p 
Mates’ accept. of 
Men 31 025 08 = 
Women .28 025 03 “4 
Others 31 025 06 = 
Mates’ status re 
et 13 30.025 
Women DRES 37 005 
Others B — 35 01 


Note.—The score for acceptance of others was the mean of 
the scores for acceptance of men plus acceptance of women, 


Table 5 


Partial Correlation of Marital Happiness with 
Self Acceptance, by Sexes, Holding Mates’ 
Happiness Constant, for 50 Couples 
Married More Than Two Years 


Husbands Wives 
(N = 50) (N = 50) 
Marital Happiness 
Correlated with— r $ f p 
Self acceptance 18 = .00 — 
Mates’ self 
acceptance 33 01 13 — 
Mates’ self 
acceptance* 32 025 —.10 — 


* Indicates second-order partial correlation holding Ss' self 
acceptance constant as well as mates’ marital happiness, 


mutual; and is probably highly related to it, 
if it could be separated from MH in general. 

In the second row of Table 5 it will be seen 
that the husbands’ MH continued to have a 
significant correlation with their wives’ self 
acceptance, regardless of the wives’ own hap- 
Piness in the marriage; and in the third row 
the same relation held even when the hus- 
band’s own self acceptance was also held 
Constant. Some unknown factor in the wives, 
not present in the husbands, caused the wives 


to make their husbands happier, regardless of 
their own happiness. 


Marital Happiness and Sex Differences 


The data bearing on the relation of MH to 
sex differences have now all been presented, 
and may be summarized as follows: (a) the 
husbands’ MH showed a markedly higher 
zero-order correlation with their wives’ self 
acceptance; (b) this correlation remained 
uniquely significant even when the wives’ own 
happiness was held constant by partial corre- 
lation; (c) both mates’ MH correlated with 
acceptance of others in the wives only; (d) 
both mates’ MH correlated with psychologi- 
cal status in the husbands only; and (e) the 
MH of both husbands and wives was unaf- 
fected by the tendency of both sexes to rate 
women in general less acceptable than men. 

In short, the wives were more influential in 
marriage, more persistent, less concerned with 
interpersonal status, and indifferent to sexual 
“inferiority. There is considerable probability 
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that this situation obtains among the popula- 
tion of wives married more than two years. 


The Newlywed Sample 


The data for the sample of 14 couples mar- 
ried less than two years are not presented in 
detail. It was assumed that the relatively un- 
settled state of the criterion, marital happi- 
ness, would tend to depress the correlations, 
and this proved to be the case in general. For 
instance, the interspouse correlation for MH, 
which was .74 in the older marriages, was 
only a nonsignificant .39 in the newer mar- 
riages. There was evidence of a somewhat dif- 
ferent pattern of correlations in the new mar- 
riages; for instance, the husbands appeared 
to be more dependent on their wives’ person- 
ality traits than the wives on their husbands’ 
personality traits. But the sample was too 
small, and too few of the correlations signifi- 
cant, to merit further description of the re- 
sults. 


Discussion 


The question naturally arises whether the 
correlation between marital happiness and 
self acceptance obtained in this study indi- 
cates that self acceptance causes MH, or MH 
causes self acceptance. This is a moot ques- 
tion. Most theoreticians of the self believe 
self acceptance to be the outcome, in large 
measure, of childhood experiences. If this is 
the case, then the results in the present re- 
search would seem highly compatible with 
Terman’s finding, supported by every subse- 
quent investigation, that childhood back- 
ground is one of the most discriminating fac- 
tors for marital happiness (12, p. 372). Self 
acceptance may be the variable intervening 
in time between childhood and marriage. 

In order to make a conclusive test of the 
causal relation, however, it would be neces- 
sary to obtain self acceptance scores before 
the marriages, which was not done. In support 
of the causal effect of personality in general 
the studies of Kelly (4), Burgess and Wallin 
(3, p. 536), and Terman and Oden (13, pP- 
257-260) may be cited, where in each in- 
stance a personality measure before marriage, 
or divorce, correlated with MH after mar- 
riage, or with divorce as a criterion. 
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The finding in this study that wives con- 
tinue to influence their husbands’ MH re- 
gardless of their own MH is compatible with 
the conclusions of Burgess and Cottrell (2, 
pp. 341-349), who cite it as one of their six 
main conclusions that American wives make 
the major adjustment in marriage. Making 
adjustments would seem to imply greater 
concern with and influence on the mate, since 
it is the mate that is adjusted to, in part. 

The failure of MH to correlate with the 
positive social trait, acceptance of others in 
the husbands was unexpected, but probably 
accounted for by the fact that MH did cor- 
relate with the husbands’ psychological status. 
Psychological status included acceptance of 
others, from which it was derived mathemati- 
cally. Apparently, some third factor in hus- 
bands, perhaps competitiveness, makes status 
more important to them than to their wives. 


Summary 


With a sample of 50 couples married more 
than two years it was shown that: 

Marital happiness is related to self accept- 
ance, acceptance of others, and psychological 
status in both subjects and their mates; to 
self acceptance in both sexes, to acceptance 
of others probably only in wives, and to psy- 
chological status probably only in husbands. 

The relation of marital happiness to self 
acceptance, acceptance of others, and psycho- 
logical status is affected in several other meas- 
urable ways by average psychological differ- 
ences between the two sexes. 
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The Social Desirability Factor in Edwards’ PPS' 


Daniel Kelleher 


University of Washington 


Edwards has published a forced choice self- 
assessment inventory, Personality Preference 
Schedule (PPS), designed to give scores on 
personality variables that are free from the 
effects of social desirability (1). The inven- 
tory consists of 225 item pairs, each pair 
made up of two items rated by college stu- 
dent judges to have similar social desirability 
values. It has been shown that correlations 
between scores on the 15 variables and social 
desirability are low (1). The present study 
was designed to see whether social desirabil- 
ity still operated on choice of item within 
item-pairs, however. 


One hundred and one Males and 101 fe- 


males from beginning psychology courses were 


given the PPS and the Social Desirability 
(SD) scale. The latter scale, described by 

dwards (1), yields scores measuring the ex- 
tent to which the subjects endorse Statements 
in a socially desirable way, Point-biserial cor- 
relations were computed separately for each 
sex between SD scale Score and choice of A 
or B for each of the 210 different item pairs. 
These correlations were found to cluster 


1An extended report of this si 
tained without charge from Dai 
Campus Parkway, Seattle, 
the American Documentati 
ment No. 5469, 
for Photocopies 


tudy may be ob- 
niel Kelleher, 1201 
Wash., or for a fee from 
on Institute. Order Docu- 
remitting $1.75 for microfilm or $2.50 


around zero, with only slightly greater than 
chance occurrence of significant correlations. 

There are 48 item-pairs in which the dif- 
ference between judged social desirability 
rating of the items in the pair is relative 
great. Correlations were computed so that i 
social desirability was operating in item 
choice, this group of 48 pairs would show 
preponderantly plus correlations. No such ef- 
fect was found. ; 

A special score, HSD score, was computed 
by counting the number of times the subject 
chose the item in a pair with the higher so- 
cial desirability rating, no matter how small 
the difference (all 210 pairs used). The mean 
HSD score for both males and females was 
higher than that expected by chance at the 
01 level of confidence. Correlations belwarn 
SD scale scores and HSD scores for each o 
the sexes showed insignificant correlations for 
Po the basis of the above results, it was 
felt social desirability played an insignificant 
role in item responses on the PPS. 


Brief Report. 
Received November 13, 1957. 


Reference 


1. Edwards, A. L. Manual, Edwards Personal PHG 
erence Schedule. New York: Psychologi 
Corp., 1954. 


100 


ne a 


LL Le 


Journal of Consulting Psychology 
Vol. 22, No. 2, 1958 


Six Measures of Self-Concept Discrepancy and 
Instability: Their Interrelations, Reliability, and 
Relations to Other Personality Measures’ 


Gene Marshall Smith 


Massachusetts General Hospital 


During recent years, largely as a result of 
the emphasis placed on the self concept by 
Rogers (19, 20), many experimental exami- 
nations of self-regarding attitudes have been 
reported (e.g., 1, 2, 3, 7, 18). One measure 
which has frequently been studied is the dis- 
crepancy between the “Self” and the “Ideal 
Self,” i.e., the discrepancy between what the 
individual says he is and what he says he 
would like to be. The present paper deals with 
this measure and five new measures of self 
concept. Three of the five new measures deal 
with the instability, over time, of the con- 
cepts of “Self,” “Ideal Self,” and “Social 
Self.” In this report, the concept of “Social 
Self” refers to the individual’s notion of how 
he is seen by other people. The remaining two 
measures deal with the discrepancy, at a given 
point in time, between “Ideal Self” and “So- 
cial Self” and the discrepancy between “Self” 
and “Social Self.” 

The present investigation was not de- 
signed to test specific hypotheses involving 
the six self-concept measures mentioned above. 


1 This report is based on work carried out during 
1955 and 1956, supported by grants to Henry K. 
Beecher, from the Medical Research and Develop- 
ment Board of the Department of the Army and 
the United States Public Health Service. A pilot 
study investigating the six self-concept variables, 
carried out in 1953 at the University of Rochester, 
was supported by a grant to G. R. Wendt, from the 
Office of Naval Research, The author wishes to ex- 
press his appreciation to R. L. Burke and J. M. 
Hoffman for their assistance with the collection and 
statistical examination of the data, and to those col- 
leagues whose critical reading greatly improved the 
manuscript: E, L. Cowen, R. B. Cattell, W. Finegar, 
D. Briggs, and A. Couch, 


Rather, it was designed to determine the in- 
terrelations among these six measures, to 
evaluate their reliability, and to explore the 
relations between them and certain other 
measures of personality. The six self-concept 
measures are given operational meaning in 
the method section and are given psychologi- 
cal meaning in the discussion section. 


Method 


. Self-Concept Test 


Twenty-four college men were given a self- 
concept test consisting of 29 personality de- 
scriptive phrases. An attempt was made to 
cover a broad range of needs, attitudes, and 
behavior tendencies with the 29 phrases. Some 
phrases were relevant to certain of Cattell’s 
16 personality factors (5); some were rele- 
vant to certain of Edwards’ variables (9); 
some were relevant to certain of the needs 
listed by Murray (17). Others were relevant . 
to no particular list of personality character- 
istics. Examples of the 29 traits are: (a) 
tends to express anger easily and is apt to be 
found in arguments; (b) tends to be ener- 
getic, alert, spirited, and enterprising; has 
great vitality and drive; (c) tends to think 
of people as being somewhat selfish, unfair, 
and self-seeking; (d) tends to be cooperative, 
agreeable, and ready to meet People at least 
halfway.? 

Administration. Each phrase was typed on 


?To Save printing costs, the complete list of 29 
traits is not presented here. It has been deposited 
with the American Documentatior Institute. Order 
Document No. 5435, remitting $1.25 for microfilm or 
$1.25 for photocopies. 
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a 3 X 5 card. The experimenter gave the S$ 
the 29 cards, one at a time, and asked him to 
sort them into five piles on the basis of the 
degree to which they described his “Ideal 
Self.” No restrictions were imposed concern- 
ing the number of cards which could be placed 
in a given pile. After this first sorting, the $ 
re-sorted these same 29 cards into five piles 
on the basis of the degree to which they 
described his “Self,” Finally, the S re-sorted 
them on the basis of the degree to which they 
described his “Social Self.” “Ideal Sel 
defined for the S as the self he would 
be—not what he thinks he ought to 
what he would like to be. “Self” 
in terms of what the S thinks he actually is. 
“Social Self” was defined in terms of the S’s 
notion of what other people think of him. 
The meaning of other people was specified 
for the S by instructing him as follows: “By 
other people we . . . are referring to people 
who know you well enough to hold opinions 
about you, but people who are not your five 
or six closest friends,” 
The five piles into which the S sorted the 
29 traits were labeled in the same manner for 
all three trait sortings. The labels used were 
Almost All of the Time,” “Usually,” “About 
Half of the Time,” “Seldom,” and “Almost 
Never.” When a trait was put in Pile 1 it 
was given a score of one, When it was put in 
Pile 2, it was given a score of two, etc. Thus 
if a given S placed a given card in Pile 1 
when sorting on the basis of “Ideal Self,” 
Pile 3 when sorting on the basis of “Self” 
a s ? 
and Pile 2 when Sorting on the basis of “So- 
cial Self,” it was interpreted as meaning he 
would like that trait to be Characteristic of 
him almost all of the time; he thinks that 
trait is characteristic of him about half of the 
time; and he thinks other people would say 
that trait is usually characteristic of him, 
Testing occasions. The S took the com- 
plete self-concept test on three separate occa- 
sions, once when Medicated with morphine, 
once with amphetamine, and once with 
placebo. The three medications were adminis- 
tered subcutaneously in doses that varied ac- 
cording to body weight. The Ss received, per 
70 kg. of body weight, 10 mg. of morphine, 
15 mg. of amphetamine, and 1 ml. of physio- 
logic saline solution as a placebo. The three 
testing occasions were separated by intervals 
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of approximately one week. Order of drug ad- 
ministration was balanced. 

The three discrepancy measures (discrep- 
ancy between “Self” and “Ideal Self,” dis- 
crepancy between “Social Self” and “Ideal 
Self,” and discrepancy between “Self” and 
“Social Self”) were based on the ratings ob- 
tained under the placebo condition only. Thus 
these measures were in no way influenced by 
the pharmacologically active ingredients in 
morphine and amphetamine. The three insta- 
bility measures (instability of “Self,” “Ideal 
Self,” and “Social Self”) were based on the 
ratings obtained under all three conditions of 
medication. However, since the self-concept 
test was only one of a series of tests adminis- 
tered to evaluate drug effect, it was given ap- 
proximately 44 hours after medication; and 
at this time, the remaining drug effects were 
weak (12, 21). Thus, at present we believe 
the point to be emphasized concerning the in- 
stability variables is not that they reflect in- 
stability produced by drugs but, rather, that 
they reflect instability occurring over time. 
This belief is now being checked in a separate 
sample of Ss tested on three separate non- 
medicated occasions. ; 

Three discrepancy measures. The following 
method was used to determine each S’s dis- 
crepancy between “Self” and “Ideal Self. 
The unsigned difference between the rating 
an S gave a trait on the “Self” dimension and 
the rating he gave that trait on the “Ideal 
Self” dimension was taken as the measure of 
his discrepancy between “Self” and “Ideal 
Self” with respect to that particular trait. The 
absolute difference between an S’s “Self” rat- 
ing and his “Ideal Self” rating was obtained 
for each of the 29 traits, and the mean of his 
29 absolute differences was taken as the meas- 
ure of his discrepancy between “Self” and 
“Ideal Self” for the test as a whole. The dis- 
crepancy between “Self” and “Social Self 
and the discrepancy between “Ideal Self” and 
“Social Self” were obtained in like manner. 

The mean of discrepancies method was em- 
ployed rather than the more frequently used 
correlation method because it was felt that 
the former is less influenced by such factors 
as number of traits comprising the trait-pool, 
response set bias, etc., than js the latter. 

Three instability measures. Each S’s ‘‘in- 
Stability of Self” score was obtained as fol- 
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lows. The variance of the three ratings a 
Particular S$ gave a particular trait on the 
“Self” dimension on the three test occasions 
was taken as that S’s degree of “instability of 
Self” for that particular trait. The variance 
of each S’s three ratings was obtained for each 
of the 29 traits. The mean of an S’s 29 vari- 
ances was taken as the measure of his “in- 
stability of Self” for the test as a whole. 
Measures of “instability of Social Self” and 
“instability of Ideal Self” were obtained in a 
like manner. 3 


Non-Self-Concept Personality Measures 


In addition to the six self-concept measures, 
49 “non-self-concept” personality measures 
were obtained for each S. Thirty-six of these 
were obtained from the following person- 
ality inventories: The Cattell 16 Personality 
Factors Questionnaire (4); the Maslow Se- 
curity-Insecurity Inventory (16); the Man- 
son Evaluation (15); the Edwards Personal 
Preference Schedule (8); the Minnesota 
Thinking, Social and Emotional Introversion- 
Extraversion Test (10). (The Edwards Test 
was taken under placebo; the rest were taken 
during the five nonmedication testing sessions 
mentioned in the following paragraph.) Of 
the 13 “non-self-concept” measures which 
were not obtained from personality inven- 
tories, 12 were measures of average-mood and 
one was a measure of self-insight. 

Average-mood measures. Information con- 
cerning average-mood was obtained as fol- 
lows: A total of 15 mood samples was ob- 
tained for a given S by having him rate him- 
self on a seven-point scale on each of 12 
bipolar mood items. These 15 samples of 
mood were obtained on the placebo day and 
on five nonmedication days, two of which 
preceded and three of which followed the 
three days on which medications were given. 
The mood items were presented to the Ss in 
the form of bipolar seven-point scales, where 
each of the two poles was defined by a brief 
sentence. For example, the extremes of one 
mood item were specified in terms of the fol- 
lowing two sentences: “I feel a little grouchy 
and probably would get mad easily.” “I feel 
very good natured and probably would not get 
mad easily.” The following is a listing of the 
remaining 11 items (abbreviated): sleepy ys. 
awake; uneasy vs. secure; mind alert vs. mind 


slow; dreamy vs. not dreamy; happy vs. sad; 
clear-headed vs. groggy; confident vs. shy; 
peppy vs. no pep; worried vs. not worried; 
calm vs. restless; unsociable vs. sociable. 

The mean of a given S’s 15 ratings for a 
given mood item was taken as the measure of 
his average-mood with respect to that par- 
ticular item. The 12 items comprising the 
mood questionnaire are based on a set of 
mood items developed by Lasagna, vonFel- 
singer, and Beecher (13). 

Self-insight measure. The self-insight meas- 
ure was obtained as follows: Two psycholo- 
gists, who had interviewed and tested each S 
for about 20 hours, rated each S on a five- 
point scale on each of the 29 personality traits 
comprising the self-concept test. After rating 
a given S on a given trait, the psychologist 
evaluated his confidence in that rating, mark- 
ing it high, medium, or low. The mean of the 
two psychologists’ ratings of an S on a given 
trait was then compared with the S’s own 
rating on that trait on the “Self” dimension 
under placebo. The amount of agreement be- 
tween the rating the S gave himself on that 
trait and the mean rating given to him by 
the two psychologists was taken as a measure 
of his self-insight with respect to that par- 
ticular trait. The discrepancy between a given 
S’s “Self” rating and the mean rating given 
to him by the two psychologists was obtained 
for each of the 29 traits. However, not all of 
the 29 discrepancies contributed to a given 
S’s self-insight score. One of the following two 
criteria had to be met before a trait was used: 
(a) a trait was used if both psychologists had 
rated the S exactly the same way on that 
trait and each psychologist had recorded high 
or medium confidence in his rating; (b) a 
trait was used if the two psychologists had 
disagreed by only one scale point and both 
had recorded high confidence in their rating 
of that S on that trait. The average number 
of traits meeting one or both of the above 
criteria was 18.5 per S. 


Results 


Intercorrelation Among the Six Self-Concept 
Measures 


Table 1 shows that each of the six variables 
is positively correlated with every other varj- 
able and that 11 of the n(n —1)/2 = 15 dif- 
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Table 1 


Correlations Among the Six Self-Concept Variables 
(N = 24) 


Discrepancy Variables 


Instability Variables 


Self- Ideal- Inst. Inst. Inst. 

Variable Social Social Self Ideal Social 
Discrepancy 

Self—Ideal +.81** +.744* +.56** +.28 +.71** 

Self-Social +.51* +.71* +.21 +.65** 

Social-Ideal +.45* +.31 +.47* 
Instability 

Self +.50* +.68** 

Ideal +.33 


* Significant at .05 level by two-tailed test. 
Significant at .01 level by two-tailed test. 


ferent comparisons are significant at or be- 
yond the .05 level, using a two-tailed test. 
The correlation coefficients were obtained 
using the formula for the Pearson product- 


moment r. Each of the six variables was dis- 
tributed approximately normally, 


Search for Artifacts 


Finding everything correlated wi 

Find with every- 
thing is rather unusual. Therefore, before a 
cepting these correlati 


used the five-point sca 
Ss used predominantly 
scale, whereas others u 


self-concept 
six self- 
suspect. 
rue if the 


$ the tend- 
ency to use a restricted range had been found 


to be associated with low discrepancy or low 
instability. However, neither of these tend- 


encies was found to be significantly correlated 
with any of the six self-concept variables. 

In searching for possible artifactual mean- 
ings of the correlations among the self-concept 
variables, the question arose as to whether or 
not certain Ss got higher instability and dis- 
crepancy scores than other Ss simply because 
they were less careful and conscientious in 
making their responses. If amount of insta- 
bility and discrepancy were correlated with 
amount of carelessness in taking the test, the 
correlations among the six self-concept vari- 
ables would be spuriously increased. The Ed- 
wards consistency variable was taken as a 
measure of carefulness-carelessness in “per- 
sonality-test-taking.” (An S’s score on the 
Edwards consistency variable depends on the 
number of times he responds to identical test 
items in the same way.) The fact that this 
variable was not found to be significantly cor- 
related with any of the six self-concept vari- 
ables was taken as evidence against the as- 
sumption that correlations among the six self- 
concept variables were spuriously increased 
by variation among the Ss with respect to 
carefulness-carelessness in taking the self-con- 
cept test. 

Another possible source of error which was 
investigated was the fact that certain of the 
six self-concept scores are not based on com- 
pletely independent data. For example, the 
discrepancy between “Self” and “Ideal Self” 
and the discrepancy between “Social Self” 
and “Ideal Self” contain a common element: 
“Ideal Self.” This problem exists in the dis- 
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crepancy vs. discrepancy correlations but not 
in the instability vs. instability correlations 
and only to a very slight degree ° in the in- 
stability vs. discrepancy correlations. Table 1 
indicates that although the correlations of the 
first of these three types are somewhat higher 
than those of the second and third types, the 
latter two types are nonetheless consistently 
high (8 out of 12 being significant at or be- 
yond the .05 level using a two-tailed test). 

It will be remembered that instability 
scores are based on variance values. An ex- 
amination of the nature of the distributions 
of the variances indicated that they are dis- 
tributed logarithmically rather than normally. 
Because the variances are logarithmically dis- 
tributed, extreme variance values on two or 
three of the 29 traits could greatly increase 
an S’s total instability score. It seemed pos- 
sible that in some way this might be spuri- 
ously increasing the correlations among the 
three instability variables. To determine 
whether or not the instability scores were in- 
deed being unduly influenced by a few items 
with high variance values, a new method of 
determining instability of “Self,” “Social 
Self,” and “Ideal Self” was developed which 
avoided this problem, and correlations be- 
tween scores yielded by the two methods were 
determined. With the new method, an S’s in- 
stability score depended on the number of 
traits, out of a possible 29, to which that S 
gave the same rating on all three test occa- 
sions. This new method of obtaining insta- 
bility scores gave the Ss scores which were 
very similar to those obtained with the mean 
of variances technique. The correlations be- 
tween instability scores based on the two 
methods were + .86, + .84, and + .79 for in- 
stability of “Self,” “Social Self,” and “Ideal 
Self,” respectively. 

3Six of the nine correlations between discrepancy 
and instability measures have a minor degree of non- 
independence. For example, one of the two sets of 
ratings contributing to an S’s score on discrepancy 
between “Self” and “Ideal Self” is the same as one 
of the three sets of ratings contributing to his “in- 
stability of Self” score, viz., his ratings of “Self” un- 
der placebo. However, it is not clear how this type 
of nonindependence could spuriously inflate the cor- 
relations involved. Furthermore, of the three correla- 
tions which are completely independent, one reaches 
the .01 level of significance and one reaches the .05 
level of significance, using a two-tailed test. 
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Perhaps the most convincing evidence 
against the supposition that the intercorrela- 
tion among the six self-concept variables is 
due to artifacts was obtained by comparing 
the discrepancy vs. discrepancy correlations 
and instability vs. instability correlations with 
the discrepancy vs. instability correlations. 
As was pointed out before, the discrepancy 
scores are based on the subtractive relation- 
ship between ratings of the traits with respect 
to two different “dimensions” on the same oc- 
casion (the placebo day), whereas the insta- 
bility scores are based on the variance of rat- 
ings of the traits with respect to the same 
“dimension” over three different occasions. 
That is, the discrepancy scores and insta- 
bility scores were obtained using different op- 
erations‘and (with the minor exception men- 
tioned in Footnote 3) were based on different 
data. In view of this, it seems reasonable to 
assume that sources of error not discovered 
in the search for artifacts, discussed above, 
would be much more likely to affect the within 
class correlations (discrepancy vs. discrep- 
ancy, or instability vs. instability) than the 
across Class correlations (discrepancy vs. in- 
stability). Following this assumption, all 15 
r values were transformed to z values, the 
mean z value for the six within class corre- 
lations and the mean z value for the nine 
across class correlations were obtained, and 
these two mean z values were transformed 
back to z values. The corrected average r 
value for the across class correlations was 
high (.51) and was encouragingly close to 
the corrected average y value for the within 
class correlations (.62). 


Reliability of the Six Self-Concept Measures 


Split-half reliability coefficients were ob- 
tained for all six measures, and test-retest 
reliability coefficients were obtained for the 
three discrepancy measures. The period in- 
tervening between the test and the retest 
varied from S to S. The minimum was 228 
days; the maximum was 420 days; the mean 
was 330 days. Using the Spearman-Brown 
correction, the split-half reliability coefficients 
for the three discrepancy variables were: 
“Self”—“Ideal Self?” = + .88; “Social Self”— 
“Ideal Self” = + .85; “Self—“Social Self? = 
+.91; those for the three instability vari- 
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Table 2 
Correlations Between Six Self-Concept Variables and 49 Non-Self-Concept Variables 
Discrepancy Variable Instability Variable 
Self- Ideal- Self- Inst. Inst. Inst. 
Measure Ideal Social Social Self Social Ideal 
Self-insight measure —.57** — 41* —.58** —.55** —.70** —.43* 
Average-mood measures 
Sleepy +.06 —.10 +.21 +.30 +.28 +.03 
Uneasy +.37 +.17 +.46* +.53**  +4.59%* +.46* 
Mind slow +16 413 +.24 +48" +432 +.29 
Dreamy +.18 —.07 +.23 +.28 +.36 +.21 
Sad +.26 +.07 +.29 +.36 +41* +.47° 
Grouchy +41* +4.22 +.42* +.39 +.60** +.51* 
Groggy +30 +14 +.32 +.48* 4.49% = 4.27 
Shy +31 +441 +.28 +32 +.48* +.40* 
No pep +35 +420 +.34 +46" 4.30 +.22 
Worried +37 4.09  +.52** +38  +.50*  +.30 
Restless +.39 +.20 +.48* +.35 +.39 +.30 
Unsociable +415 = 03 +.21 +.19 +.30 +.33 
Manson maladjustment +.67** 4.37 +.64** +.59**  +.40* +.46* 
Maslow insecurity +.72** = 4.44* +.65** +.55**  -+.49* +.43* 
Edwards variables 
Achievement y —10 — 19 —.26 —.24 —.13 —.39 
Deference =A =03 —.28 —.02 +.05 +.22 
Order —02 407  —07 —.28 -16 4.03 
Exhibition —.05 —.08 +.06 +.14 .00 —.23 
Autonomy 4.05 4.17 —.03 +.13 +.06 +.14 
Affiliation —.02 — 01 +.09 — AL —.22 —.05 
Intraception ~.28 = 12 15 +.09 —.23 +.43* 
Succorance + 45* rire +.47* +.22 +.16 +.17 
ominance ~18 — "39 ERT: —.10 +.06 =.45* 
Abasement +.29 +21 +.24 +.23 +.34 +.21 
Nurturance +.19 +26 +18 —.03 +.02 +.23 
Change —.38 — 34 =,35 +11 —.14 +.13 
Endurance = 37 _ 32 —.40* =—.19 —.36 
ira +.18 +29 +18 PET, 442 —.01 
ssion * ‘ =, 
TSE extraversion +2 Te ee wee nee = 
ee —12 +405 01 +.16 00 +47 
Traction 1 +52" —.66%* —30 =a =a A 
umo a S 
Cattell factors +27 tag pine? a T08 E2 
A- Cyclothy mis ia 00 03 —08 =n 08 
B—Intelligence _ +.63** 4.49 4.43 +.24 4.38 +05 
C—Emot. stability 55A —44* = 83 —10 —12 +.14 
pp pominance —.37 —.39 —.20 —.17 —.54* —.32 
"—Surgency —.22 —.31 —.06 = .13 —.03 
G—Charac. strength +.03 +.05 = —.12 o -+.04 
H— Adventurous =i Ss = 245 20 —.04 
I—Emot. sensitivity +47* 421 +.37 +4.25 +13 4.02 
L—Paran. schizothym. +.19 +.25 +.23 +.40 +4.05 +.26 
M—Bohemianism +44* 4:28 4o +24 412 4.14 
N~Sophistication +15 +430 +224 +35 098 +.24 
O—Anxious insecurity +.00 4.42 AL 4.98 +26 +4.34 
Qi—Radicalism +.29 16 +16 Ls, 16 es ‘02 Re 21 
Q:—Independent +45*  +4.61%* 4.29 +27 $09 4-41 
Os wil control e = 42 = 38 — 38 —46* 37 _ 39 
Q:—Nervous tension +48" 448 438 +34 413 446" 
Note.—For correlations involving Cat 


tell Factors, N = i = 
* Significant at .05 level by two-tailed test. Fe ee For all other correlations, N = 24. 


icant at .01 level by two-tailed test. 
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ables were: “Self” = + .78; “Social Self” = 
+ .86; “Ideal Self” = + .75. The test-retest 
coefficients for the three discrepancy variables 
were: “Self”—“Ideal Self” = + .82; “Social 
Self’—“Ideal Self” = + .63; “‘Self”—“Social 
Self” = + .78. All of these correlations were 
plotted to be certain that they were not be- 
ing spuriously increased by a few Ss with ex- 
treme scores. It was found that the correla- 
tions held throughout the scattergrams. 

In a subsequent study of the reliability of 
the three discrepancy variables, in a group of 
Ss whose discrepancy scores covered narrower 
ranges * than those covered by the 24 Ss in 
the present study, somewhat lower reliability 
coefficients were obtained. In the subsequent 
experiment, the three discrepancy variables 
yielded split-half coefficients of + .79, + .83, 
and + .75. With an interval of two weeks, 
the test-retest coefficients were + .77, + .77, 
and + .60. The self-concept test is now un- 
dergoing item analysis in an effort to increase 
its reliability when used with Ss whose scores 
cover only moderate ranges. 


Correlations Between the Six Self-Concept 
Measures and Other Personality Meas- 
ures 


Table 2 reports correlations between each 
of the six self-concept variables and 49 “non- 
self-concept” measures of personality. A strik- 
ing characteristic of the correlations reported 
in Table 2 is the consistency of the associa- 
tion between measures of adjustment and 
measures of self-concept discrepancy and in- 
stability. These correlations indicate that high 
instability scores and high discrepancy scores 
are associated with poor adjustment scores, 
whereas low instability scores and low dis- 
crepancy scores are associated with good ad- 
justment scores. 

The consistent correlation between meas- 
ures of self-concept discrepancy and insta- 
bility on the one hand, and measures of 

4For example, in the subsequent experiment, the 
S with the highest total discrepancy between “Self” 
and “Ideal Self” had an average item discrepancy of 
1.36 scale points, and the S with the lowest total dis- 
crepancy between “Self” and “Ideal Self” had an av- 
erage item discrepancy of 0.32 scale points. In con- 
trast, in the experiment reported in the present paper, 
the highest average discrepancy between Self” and 
“Ideal Self” was 1.93 scale points, and the lowest was 


0.14 scale points, 


adjustment on the other hand, suggests one 
reason for the intercorrelation among the self- 
concept variables—namely, that the six self- 
concept variables are correlated with each 
other because all of them are correlated with 
a common variable: adjustment. 


Discussion 


Psychological Meaning of the Six Self-Con- 
cept Measures 


Since the meaning of the correlations re- 
ported in Tables 1 and 2 depends on the 
meaning of the six self-concept variables in- 
volved in these correlations, it seems desir- 
able to specify what we at present assume to 
be the psychological meaning of these six 
variables. The meaning of each variable will 
be given by indicating the psychological mean- 
ing which we attribute to a high score on that 
variable. 

1. A high discrepancy between “Self” and 
“Tdeal Self” indicates that the S feels inade- 
quate relative to his ideal; that is, he evalu- 
ates himself unfavorably. 

2. A high discrepancy between “Social Self” 
and “Ideal Self” indicates that the S feels 
that other people perceive him in ways which 
are very different from Ais standard of per- 
fection; that is, he feels that their perceptions 
of him are, relative to his own ideal, unfa- 
vorable. 

3. A high discrepancy between “Self” and 
“Social Self” indicates that the S thinks that 
other people do not accurately perceive and 
understand him. 

4. High “instability of Self” indicates that 
the S’s attitudes toward himself undergo 
marked change from time to time. 

5. High “instability of Social Self” indi- 
cates that the individual changes markedly 
from time to time concerning what he believes 
other people think of him. 

6. High “instability of Ideal Self” indi- 
cates that the individual’s goals, values, and 
ideals fluctuate markedly over time. 


Interrelations Among the Six Self-Concept 
Measures 


If the above attribution of meaning to the 
six self-concept variables is accepted as rea- 
sonable, then the positive correlations among 
these six variables become quite reasonable. 
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It is not surprising, for example, that the S$ 
who evaluates himself unfavorably (high dis- 
crepancy between “Self” and “Ideal Self”) 
also tends to react in the following ways: he 
feels that he is evaluated unfavorably by 
others (high discrepancy between “Social 
Self” and “Ideal Self”); he feels misper- 
ceived by others (high discrepancy between 
“Self” and “Social Self”); he changes mark- 
edly from time to time concerning what he 
thinks he is (high “instability of Self”); he 
changes markedly from time to time concern- 
ing what he thinks other people think of him 
(high “instability of Social Self”); and he 
changes markedly from time to time concern- 
ing what he would like to be (high “insta- 
bility of Ideal Self”). Similarly, it is not sur- 
prising that the S who evaluates himself 
favorably also feels evaluated favorably by 
others, also feels understood by others, and 
also has rather stable ideas about what he is, 
what he believes others think of him, and 
what he would like to be. 
Stating that the intercorrelation among the 
six self-concept variables is reasonable and is 
ue to experimental artifacts does not 
n this intercorrelati 


concerning himself, 
this sort does not 
Present report. 
Dynamics. It might be useful, however, to 
mention just a few observations and hunches 
(suggested by numerous observers of human 
behavior: W, James, G. H. Mead, P. Lecky, 
C. Rogers, H. $. Sullivan, K. Horney, to 
mention a few) which might be helpful in 
5 Following Feigl’s (11) definition of explanation 
as being the “inductive-deductive or (on higher lev- 
els) hypothetico-deductive derivation of the more 
specific (ultimately descriptive) Propositions from 
more general assumptions (laws, hypotheses, theo- 
retical postulates) in conjunction with other descrip- 


tive propositions (and often together with defini. 
tions) d 


seem appropriate in the 
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developing such an explanation. For example, 
the statements presented in the following 
three paragraphs might, if they are valid, 
shed some light on the factors involved in the 
production of the correlations between the 
“Social Self”—“Ideal Self” discrepancy and 
the other five measures of self-concept dis- 
crepancy and instability. (Earlier in this sec- 
tion we assumed that a high discrepancy be- 
tween “Social Self” and “Ideal Self” indicates 
that the S feels that the perceptions of him 
held by other people are, relative to his own 
standard of perfection, unfavorable. For the 
sake of speculation, we now assume that the 
degree of discrepancy between “Social Self 

and “Ideal Self” reflects the degree to which 
the individual feels valued by other people 
The following statements are presented merely 
to exemplify the way in which speculation 
about events which might influence the de- 
velopment of various aspects of the self-con- 
cept might give some meaning to the five cor- 
relations involving the “Social Self”—“Ideal 
Self” discrepancy. (The remaining 10 corre- 
lations will not be treated in this manner in 

resent report.) 

me ihe correlation between the “So- 
cial Self’—“Ideal Self” discrepancy and the 
“Self”—“Ideal Self” discrepancy, where r = 
+ .74, one might speculate as follows: The 
child’s ideas about, and valuations of, him- 
self are profoundly influenced by what he be- 
lieves to be the ideas held about him and the 
valuations made of him by other people with 
whom he interacts. That is, early in life the 
individual learns what to think of himself by 


observing what others think of him. If one ` 


feels highly valued by others, he is likely a 
value himself highly. If one does not ka 
highly valued by others, he is not likely 
value himself highly. 

Concerning the correlation between the 
“Social Self”—“Ideal Self” discrepancy an 
the “Self”—“Social Self” discrepancy, where 
r= + .51, one might say: To feel valued by 
others is a powerful human motive. If an in- 
dividual feels that he is not valued by others, 
he may attempt to deal with the disappoint- 
ment by concluding that he is not valued be- 
cause he is not understood, 

Concerning the correlations between the 
“Social Self”—“Ideal Self” discrepancy and 
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the instability of “Ideal Self,” “Self,” and 
“Social Self,” where the r values are + .31, 
+ .45, and + .47, respectively, one might 
say: The frustration of an individual’s desire 
to feel valued by others, and the consequent 
attempts to understand w/y he is not valued, 
could lead to uncertainty and confusion con- 
cerning (a) the ideals and standards he should 
try to maintain, (0) the qualities and charac- 
teristics which he feels comprise his “Self,” 
and (c) the validity of his notions of what 
other people think of him. 

Additional data needed. Before engaging in 
further speculation concerning the possible 
meanings of the positive correlations among 
the six self-concept variables, it seems desir- 
able to obtain considerably more empirical 
data dealing with such questions as: Are the 
correlations reported in the present paper re- 
peatable; and, if so, in what population of 
Ss? What personality characteristics distin- 
guish individuals who contribute to these 
positive correlations from individuals who do 
not? In what ways are the six self-concept 
variables similar to and different from each 
other in meaning, i.e., what personality vari- 
ables correlate similarly with the six self- 
concept variables with respect to magnitude 
and direction; and what personality variables 
correlate differentially with the six self-con- 
cept variables with respect to magnitude and 
direction? How do these six self-concept vari- 
ables relate to other self-concept dimensions? 
It might be particularly worthwhile to deter- 
mine the way in which these six variables 
relate to a measure of Lecky’s (14) concept 
of “self-consistency.” What are the develop- 
mental relations among the six self-concept 
variables? For example, one might expect the 
development of the ideas and attitudes re- 
flected by the “Social Self”—“Ideal Self” dis- 
crepancy to be important in affecting the de- 
velopment of those reflected by the other five 
variables. Do the instability variables reflect 
the degree of unclarity of ideas and attitudes 
relating to the self; or do they reflect con- 
flicting and mutually inconsistent ideas and 
attitudes; or do they reflect both; or do they 
reflect neither; or do they reflect one in some 
Ss, the other in some Ss, both in some Ss, and 
neither in some Ss? 
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Relations Between the Six Self-Concept Vari- 
ables and Other Personality Measures . 


At present, perhaps the most useful way of 
giving meaning to the six self-concept vari- 
ables is by specifying the way in which they 
are correlated with other measures of person- 
ality which have already acquired meaning. 
Table 2 presents these correlations. Ideally, 
the meaning of the “non-self-concept” meas- 
ures should be given by specifying the items 
on which they are based and by presenting 
the validity information concerning these 
measures. However, space limitations prevent 
this in the present paper. 

In the results section, it was stated that 
there is a highly consistent tendency for high 
discrepancy and high instability of self-con- 
cept to be associated with poor adjustment 
and for low discrepancy and low instability 
to be associated with good adjustment. The 
acceptability of this statement depends on 
the acceptability of the assumption that the 
“non-self-concept” measures, which are cor- 
related with the self-concept variables, do in- 
deed measure some aspect of maladjustment- 
adjustment. In the present paper, extensive 
effort to justify this assumption will not be 
made. 

Self insight. Table 2 indicates that all six 
self-concept measures are negatively corre- 
lated with self-insight at or beyond the .05 
level of confidence, using a two-tailed test. 
That is, high discrepancy on all three dis- 
crepancy measures and high instability on all 
three instability measures are associated with 
low self-insight. This finding is congruous 
with Rogers’ conception (20) of the relations 
among adjustment, self-awareness, and dis- 
crepancy between “Self” and “Ideal Self.” 

Average mood. Table 2 shows that 19 of 
the 72 correlations between self-concept meas- 
ures and measures of average-mood are sig- 
nificant at or beyond the .05 level, using a 
two-tailed test. These 19 correlations indicate 
(and the remaining 53 suggest) that high self- 
concept discrepancy and high self-concept in- 
stability are associated with reporting feeling 
uneasy, grouchy, worried, nervous, groggy, 
shy, sad, not peppy, mentally slow, dreamy, 
unsociable, and sleepy. Of the 33 correlations 
between self-concept variables and average- 
mood variables which do not reach the .95 
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level of significance, only three fail to be con- 
sistent with the statement that high self-con- 
cept discrepancy and instability are associ- 
ated with the mood characteristics specified 
in the previous sentence. These 72 correla- 
tions yield an unusually consistent picture. If 
an S’s ratings of his mood on the 12 mood 
items on the 15 different occasions are taken 
as valid indications of the way he generally 
feels, the correlations between self-concept 
measures and average-mood measures indi- 
cate that Ss with high self-concept discrep- 
ancy and high self-concept instability feel 
more anxious, irritable, unhappy, and inade- 
quate than do Ss with low self-concept dis- 
crepancy and low self-concept instability. 
These correlations 


who disapproves of hi 
between “Self” and 


others disapprove of him (high discrepancy 


“Ideal Self”) and 
ers (high discrep- 
“Social Self”) and 
able notion of what 


“Tdeal Self,” and 
anxious, irritable, 


Similarly, 


think of him, would feel 
happy, and adequate, 
Manson and Maslow questionnaires. The 
correlations between self-concept measures 
and the Manson and Ma 
that high self- 


bility are associated with high “Manson in- 
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Edwards variables. Most of the correlations 
between the self-concept variables and the 
Edwards variables are not high enough to be 
significant at the .05 level using a two-tailed 
test. However, when the total configuration of 
correlations between the Edwards variables 
and the self-concept variables is examined, it 
is seen that high discrepancy and high in- 
stability consistently tend to be associated 
with need characteristics which are frequently 
found in poorly adjusted individuals. (The 
correlation between “instability of Ideal Self 
and need intraception may be an exception.) 
Need succorance, need dominance, need en- 


durance, and need intraception are associated - 


with one or more of the six self-concept vari- 
ables at the .05 level of confidence using 4 
two-tailed test. High instability and discrep- 
ancy are associated with high need succorance, 
low need dominance, low need endurance, and 
high need intraception. Although not signifi- 
cant at the .05 level of confidence, the corre- 
lations between the self-concept scores and 
scores on need abasement, need achievement, 
and need aggression indicate that high insta- 
bility and discrepancy might be associated 
with high need abasement, low need achieve- 
ment, and high need aggression. - 

T-S-E measures. Only the Social scale in 

e Minnesota Thinking, Social, and Emo- 

r Introversion-Extraversion Test corre- 
lates significantly with the self-concept var. 
ables. Four of the six self-concept variables 
correlate with the Social Tritroversion Dar 
version variable at or beyond the .05 level o 
confidence, using a two-tailed test. High self- 
concept discrepancy and instability are asso- 
ciated with social introversion. 

Cattell factors. The correlations between 
the Cattell Factors and the self-concept varl- 
ables agree with the findings discussed above 
in that high self-concept discrepancy and in- 
stability are associated with poor adjustment. 
Table 2 indicates that one or more of the 
six self-concept variables is significantly pos! 
tively correlated with Factors M, O, and Qs, 
and significantly negatively correlated wit 
Factors, C, E, and Qs. Although not signifi- 
cant at the .05 level of confidence, there is a 
consistent tendency for the self-concept vari- 
ables to be positively correlated with Factor 
L. In other words, high discrepancy and in- 
Stability are associated with high Factor M 
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(“Hysteric Unconcern” or “Bohemianism”), 
high Factor O (“Anxious insecurity”), high 
Factor Q4 (“Nervous tension”), low Factor 
C (“Emotional stability”), low Factor E 
(“Dominance or ascendance’”’), low Factor 
Qs (“Will control and character stability”), 
and high Factor L (“Paranoid schizothymia”) . 
Cattell has recently reported (6) that five of 
these factors (viz., O, Qu, C, Qs, and L) are 
found to comprise a second-order factor, 
which he names Anxiety vs. Dynamic Inte- 
gration. Cattell suggests three alternative 
interpretations of this second-order factor: 
“first, that it is a factor of general anxiety; 
second, a factor of general neuroticism; and 
third, that it is the different form of per- 
sonality disorganization associated with psy- 
choticism” (6, p. 416). In this second-order 
factor, the primary factors O, Qs, and L have 
positive signs, while Qs and C have negative 
signs. Of the 30 correlations between the six 
self-concept variables and the five primary 
factors comprising this second-order factor, 
29 are consistent with the conclusion that 
high scores on the six self-concept variables 
are indicative of poor adjustment. Seven of 
these 29 correlations are significant at or be- 
yond the .05 level using a two-tailed test. 

General comments. The principal findings 
of the present study are that the six self- 
concept variables are positively correlated 
with each other and are negatively correlated 
with adjustment. The high intercorrelation 
among the six self-concept variables (Table 1) 
and the consistency of their correlation with 
various measures of adjustment (Table 2) 
help clarify the meaning of these six self-con- 
cept variables by indicating the ways in which 
they are similar. However, clarification of 
meaning can also be obtained by indicating 
the dissimilarities among these six variables. 
Data obtained from a sample considerably 
larger than that of the present study, ana- 
lyzed with factorial techniques, would be use- 
ful in this respect. 

Even within the present data, however, 
there are some suggestions concerning the 
ways in which the six self-concept variables 
might differ. For example, Table 1 indicates 
that “instability of Ideal Self” is probably 
the most unique of the six variables. Table 2 
also offers some suggestions concerning pos- 
sible differences among these six variables. 
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For example, the Cattell factors correlate 
higher with the discrepancy variables than 
with the instability variables. This is par- 
ticularly true of the correlations involving the 
discrepancy between “Self” and “Ideal Self.” 
On the other hand, the average-mood vari- 
ables correlate higher with the instability 
than with the discrepancy variables. This is 
particularly true of the correlations involving 
the “instability of Social Self.” 

Theorists and experimenters have found the 
discrepancy between “Self” and “Ideal Self” 
to be a useful measure. Perhaps further study 
of the other five self-concept measures dis- 
cussed in the present paper would show them 
also to be of value. This would be particularly 
likely in the case of the discrepancy between 
“Social Self” and “Ideal Self,” if it were found 
that the development of the ideas and atti- 
tudes reflected by this measure is important 
in affecting the development of the ideas and 
attitudes reflected by the other five self-con- 
cept variables. 

Further study of the three instability vari- 
ables also seems worthwhile. Inability to 
maintain a stable conception of the “Self,” 
“Ideal Self,” and “Social Self” is associated 
with low self-insight and with other aspects 
of maladjustment, such as anxiety, hostility, 
dejection, and feelings of inadequacy. A thor- 
ough understanding of this association should 
be useful in the further development of per- 
sonality theory and therapeutic technique. If 
it were found, for example, that individuals 
with high “instability of Self” scores allow 
their self-evaluations to be inordinately influ- 
enced by immediately preceding successes, 
failures, approvals, disapprovals, etc., whereas 
individuals with low scores anchor their self- 
evaluations firmly in the events of their total - 
past, then the meaning of the association be- 
tween “instability of Self” and various meas- 
ures of adjustment would become clarified. 


Summary 


Scores on six self-concept measures were ob- 
tained for each of 24 college men. These six 
measures were: discrepancy between “Self” 
and “Ideal Self,” discrepancy between “Self” 
and “Social Self,” discrepancy between “So- 
cial Self” and “Ideal Self,” “instability of 
Self,” “instability of Ideal Self,” and “in- 
stability of Social Self.” All six measures were 
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found to be positively correlated with each 
other. Eleven of the 15 correlations were sig- 
nificant at the .05 level of confidence using a 
two-tailed test. The Possibility of spuriously 
high intercorrelation among the six self-con- 
cept measures was examined, and the reasons 
for rejecting this Possibility were discussed. 
Split-half reliability coefficients were ob- 
tained and reported for all six measures, and 
obtained and re- 
ancy measures. 


Trelations, it was con- 
lf-concept variables are 


highly related to suc! adjustment 


as self-insight, anxiety, dejection 
insecurity, social intr ionik 
etc. High discrepancy 
crepancy measures, and hi 


concept variables is 
common variable: a 
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Differentiation of Clinical Groups Using 
Canonical Variates' 
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The present study is part of an investiga- 
tion into the factors which influence the re- 
production of simple designs by drawing, and 
represents an extension of work by Shapiro 
(11, 12, 13) and Yates (14) into rotation 
effects. The generalizations put forward by 
Shapiro to account for the greater amounts 
of rotation found among brain-damaged sub- 
jects (13) were used in predicting certain 
other anomalies which would be found in the 
drawing reproductions of that group. The 
main notion which led to the measures (i.e. 
measures other than the rotation of designs) 
being taken in the recent study was that ex- 
aggerated negative induction effects result in 
the restriction of the available perceptual 
cues in brain-damage patients. 

This paper presents the results obtained 
from a canonical variate analysis employing 
four measures or tests derived from the ap- 
plication of Shapiro’s generalizations about 
the effects of brain damage to the Drawing 
Rotation Test (14). The main aim of the 
analysis was to improve the differentiations 
obtained between brain-damaged and nonor- 
ganic groups. Other studies (4, 5) making 
use of this statistical technique have produced 
favourable results so far as differentiation is 


concerned. 


The Measures 


The Drawing Rotation Test comprises 40 
model designs which are placed in front of 
the subject (S) at specified distances, and he 
is asked to copy them by drawing. All the de- 


1The work reported in this paper was made pos- 
sible by a grant from the Research Fund, made 
available from the endowment by the Board of Gov- 
ernors of the Bethlem Royal and Maudsley Hospitals. 


signs are simple, symmetrical, and capable of 
reproduction using four Kohs blocks. Ten dif- 
ferent designs are used in all, each of which 
appears four times in the test series, once in 
each of the four possible combinations of fig- 
ure and ground orientations. Three examples 
of these designs are shown in Fig. 1. The 
models may be in either square or diamond 
orientation, and it has been found (12, 13) 
that organic Ss show a tendency to rotate 
their reproductions (i.e. to produce discrep- 
ancies in orientation between the model and 
their reproduction), which is greater than 
that found among nonorganic patients. Our 
first measure, therefore, was an index of the 
extent to which reproduction misorientation 
occurred, this index being the mean rotation 
score for the 40 designs given. We have called 
this measure Test 3. A measure of the time 
taken to complete the first eight designs was 
called Test 4. In the Rotation Test an S is 
allowed up to three minutes in which to com- 
plete any design, although failure to do so in 
the given time is very rare. The time meas- 
ure, which has been found to differentiate be- 
tween normals and abnormals (2), was the 
mean time, in seconds, which the S took to 
complete the first eight designs out of the 
series of forty. The decision to consider only 
eight designs for Test 4 was quite arbitrary 
and purely a matter of convenience in mak- 


Fig. 1. Three examples of the designs used in the 
study. 
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> te 
ing the necessary measurements. This limita- 
tion of the number of designs also applied to 
Tests 1 and 2 where the scoring procedure 
was too time-consuming to permit considera- 
tion of a large number of reproductions. 
Test 1, called disproportionality (2), may 
be looked upon as an index of the magnitude 
of errors in bisection. Almost all the designs 
used in the test have their internal structure 
so arranged that certain lines exactly bisect 
the external framework of the design. Dis- 
Proportionality represents a ratio of parts of 
the design which, because of bisecting inter- 
nal parts, should be equal in length. Lack 
of Proportionality, or dis 
measured by dividin 
lengths which sho 
In all, twenty 
tained from t 
disproportion. 


Test 2, colour scor 
to estimate the exte 


spondence between the two measures, 


The Samples 

Five groups of Ss wer, 
tistical analysis of the fou 
mals, 20 neurotics, 26 scl 


€ used in the sta- 
a measures, 48 nor- 
hizophrenics, 17 de- 
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pressives, and 33 brain damaged, making a 
total of 144 Ss. Most of these Ss were tested 
by three other investigators in the Maudsley 
Hospital as part of their research program. 
We are indebted to these experimenters for 
allowing us to make use of the drawings col- 
lected by them. Special care was taken in the 
case of functional patients and normal Ss to 
exclude those persons with symptoms or his- 
tory which were consistent with the possi- 
bility of brain damage. 


The normals comprised Ss drawn from adult edu- 
cation classes, nurses, secretarial staff, and other 
miscellancous occupations, J 

The brain-damaged group could be divided ing 
two subgroups: a group of patients from the Nena 
surgical Unit of the Maudsley Hospital whose brai 
injury was a result of surgical interference ea 
temporal lobectomy cases), and a group whose brat 
injury was due to some disease process (e.g, GPD 
It was found that these two categories did not dif- 
fer significantly in terms of their drawing test scores. 

The depressives were not all psychotic conditions 
but included some neurotic depression cases. TA 
main distinguishing feature of this group was tha 
all the individuals comprising the group were to re- 
ceive ECT as part of their treatment to relieve a 
depressed condition. 


The schizophrenics included early and chronic 
cases in about equal proportions. They were drawn 
mainly from the Maudsley Hospital. ; 

The neurotic group was composed almost entirely 
of patients diagnosed as “hysteric” or “anxiety eta 
All of these Ss were drawn from the patient popula 
tion of the Bethlem and Maudsley Hospitals. 


In all, five groups of Ss were tested by son 
different experimenters at more than oni 
hospital. 


The Problem 


Comparing the five groups on the tou 
Drawing Test measures produced signi i 
differences between them, The statistical i 
tails of these differences are shown in Table $ 
It will be seen that where disproportionality 
(Test 1), colour (Test 2), and rotation (e 
3) are concerned the differences are mainty 
between brain-damaged and non-brain-dart- 
aged groups, while on time (Test 4) the di 
ferentiation js mainly between normal an 
abnormal groups. 

owever, although significant differences 
between the groups on these measures are ob- 
tained, we are left with large areas of ae 
Classification, and the results have limited 
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Table 1 


Significance of Differences Between the Groups on the Drawing Test Measures 


F ratios 
Test 1 Test 2 Test 3 Test 4 
9.379** 8.687** 3.743** 19.613** 

t (2-tail) 

Groups compared Test 1 Test 2 Test 3 Test 4 

Brain damaged v. normal 3.538** 4.192** 3.3375" 7.920** 
Brain damaged v. depressive 2.547* 2.488* 1.714 1.731 
Brain damaged v. schizophrenic 4.726** 5.446** 2.378* 1.150 
Brain damaged v. neurotic 3.856** 4.006** S218" 3.252%% 
Normal v. depressive 0.139 0.757 0.977 4.601** 
Normal v. schizophrenic 1.773 1.891 0.541 6.220** 
Normal v. neurotic 1.088 0.662 0.587 33010" 
Depressive v. schizophrenic 1.514 2,176* 0.458 0.689 
Depressive v. neurotic 0.477 1.187 1.310 1.225 
Schizophrenic v. neurotic 0.477 0.477 0.968 2.081* 


Note.—Tests 1, 2, 3, and 4 refer to the measures Disproportionality, Colour, Rotation, and Time, respectively. 


* Significance of .05 or above. 
** Significance of .01 or above. 


clinical value. Even in the case of brain- 
damaged subjects, the outcome is disappoint- 
ing, for the bulk of this group overlaps with 
other groups. 

The main task at this stage, therefore, was 
to attempt to improve the differentiation be- 
tween the groups. The method chosen to 
achieve this end was, as stated above, a dis- 
criminant function analysis. The statistical 
model employed in such an analysis is now 
briefly described. 


The Statistical Model 


The model is one of finding a linear func- 
tion, or orthogonal linear functions, of the 
test scores which will best discriminate be- 
tween the groups. If x; to x4 are taken to rep- 
resent the four tests and 2; to #4 are weights, 
such a function has the form: 


(1) 


It will be realised that when only two 
groups are concerned, a solution to the prob- 
lem is provided by Fisher’s linear discrimi- 
nant function (6). When more than two 
groups are concerned, it cannot be assumed 
that the group means are colinear and a 
method is required which will indicate the 
number of dimensions in which the group 
means lie. One approach to the problem is 


f(u) = MXi + uote + Usks + Us%4 


that described by Rao (9) and used by Rao 
and Slater (10). The procedure involves 
maximising Mahalanobis’ D*. Another ap- 
proach is that described by Lubin (7) and 
illustrated in a recent article by Eysenck (3). 
Here the square root of the correlation ratio, 
n, between the groups, on the one hand, and 
a linear function of the test scores, on the 
other, is maximised. This is the procedure 
followed here. It involves calculating a prod- 
uct-sum matrix, G, for the combined groups 
on the tests concerned, and a between-groups 
product-sum matrix, B. The problem then is 
to find a set of weights, i.e., a column vector, 
u, which will maximise the expression: 


q? = uw Bu/u'Gu 


where w’ is the transpose of u. 

On differentiating this expression with re- 
spect to and equating the result to zero, the 
determinental equation which gives the re- 
quired values of u and the corresponding 
values of „°? is obtained. It is: 


(GAB — Iju =0 


where J is a unit diagonal matrix. 

The solution of equation (3) involves find- 
ing the latent roots and latent vectors of the 
asymmetric matrix GB (8). The number of 
latent roots possible will depend on the rank 


(2) 


(3) 
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of the matrix. This can be shown (7) to be 
the number of tests or one less than the num- 
ber of groups, whichever is smaller. 

It follows that when only two groups are 
being considered equation (3) will give, at 
most, one latent root. This is in agreement 
with the fact that one dimension is sufficient 
to account for two mean points. In our ex- 
ample, five groups and four tests are con- 
cerned, so that the rank of our G-'B matrix 
is four, and the matrix will have four latent 
roots. However, these roots may not all be 
significant. The number which is significant 
indicates the number of dimensions necessary 
and sufficient to account for the group means. 

The assumptions involved when the above 
method is employed are not always clearly 
stated. In the first place, the variance-covari- 
ance matrices for the individual groups should 
be homogeneous, otherwise one 
fied in combinin: 
total product- 
quired that the score 


Analysis of the Data 

The original raw scores on 
were not normal 
Spection, a lo 
employed to 


each of the tests 
ly distributed and, after in- 
garithmic transformation was 
Stabilize their variances. This 


ional advanta e of makin 
data more normal, : hi 


. Inspection of the standard deviations, given 
in Table 2, reveals some discrepancies. In 
each test the standard deviation for the 


brain-damaged group is the largest and on 
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the first test is roughly three times as large 
as that for any other group. To check on the 
significance of these differences, F ratios be- 
tween variances on the tests were performed. 
These showed no differences between the 
variances on Test 4, time, but on Tests 1, 
disproportionality, 2, colour, and 3, rotation, 
the variances for the brain-damaged group 
were found to differ significantly from that 
of the group with the lowest variance on each 
of the tests. In other words, homogeneity of 
variance between the groups on Tests 1, 2; 
and 3 has not been achieved. , 

As a result, our data are not ideally suited 
to the statistical model proposed since the 
brain-damaged group has an advantage over 
the other two groups in that it is more night 
weighted on account of its larger standar 
deviations. However, from a practical point 
of view, this may not be a bad thing since 
the brain-damaged patients are precisely 
those which we are most interested in dif- 
ferentiating from the others. 

There is no simple way of testing for ho- 
mogeneity of covariance between covariance 
matrices derived from small samples, but 
rank-order correlation coefficients between the 
tests for each sample separately and the 
product-moment correlations for the com- 
bined samples were calculated. The results 
gave no indication of gross departures from 
homogeneity of covariance between the groups. 
The product-moment correlations for the com 
bined groups are given in Table 3. 2 

In view of the findings in these preliminary 
investigations, it appeared reasonably legl 
mate, though not ideally so, to proceed T 
the calculations and obtain the latent poo 
and corresponding latent vectors of the ma 


Table 2 
Means and Standard Deviations of Transformed Drawing Test Scores 
Test 1 Test 2 Test 3 Test 4 
= aa 
Group Mean Sp Mean sp Mean SD Mean SD 
Normal 0.1219 0.0584 1.0400 0.0548 0.6265 0.1882 0.0482 0.2004 
Brain damaged 0.1870 0.1411 1.0948 0.0776 0.8297 0.3754 1.4309 0.2364 
Depressive — 0.1251 0.0520 1.0522 0.0400 0.7003 0.2817 1.3284 0.1995 
Schizophrenic 0.0868 0.0420 1.0139 0.0362 0.6620 0.2442 1.3748 0.2166 
Neurotic 0.0983 0.0384 1.0300 0.0436 0.5846 0.1894 1.2412 0.2004 
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Table 3 


Correlations Between the Measures for the 
Total Group 


Tests 
Tests 1 2 3 4 
1 0.62 0.59 0.30 
2 0.44 0.12 
3 0.30 


trix GB. The latent roots in order of ex- 
traction were 0.3849, 0.2231, and 0.0137; the 
percentage variance accounted for by each 
being 61.9, 35.9, and 2.2, respectively. The 
first two roots were found to be highly sig- 
nificant, while the third was not significant 
(1). This showed that the means of the 
groups on the tests could be represented ade- 
quately in a two-dimensional space. 

The latent column vectors, corresponding 
to the first two latent roots, were then found. 
They are, respectively: 


— 0.2194 1.0000 0.6552 


0.0317 
and 

1.0000 0.8018 

Using these values as weights in the equa- 

tion (7), two linear functions of the test 

scores are obtained: 
X, = — 0.21941 + 1.0000x»2 
+ 0,0317x3 + 0.6552x5 (4) 


Xa = 1.0000x, + 0.801872 
— 0.0746x3 — 0.1922%4 (5) 


— 0.0746 — 0.1922 


On substituting, in turn, the scores of each 
individual in these equations, composite scores 
for each on the new variates X1 and Xz are 
obtained. These variates are sometimes called 
“canonical variates”; they are orthogonal to 
each other. The correlation ratio between the 
X, scores and the groups is given by the 
square root of the first latent root, namely, 
0.6204. It is the maximum correlation ratio 
possible between the groups and any linear 
function of their scores. The Xə scores, in 
turn, give a correlation ratio with the groups 
equal to the square root of the second latent 


root, that is, 0.4723. 
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In Fig. 2 the means of the canonical vari- 
ate scores for the five groups are plotted. 
From this figure a picture of the relative po- 
sitions of the group means is obtained. 


Classification 


At this stage, a further aspect of the prob- 
lem of discriminating between the groups can 
be considered. This involves calculating for 
each individual the likelihood of his belong- 
ing to each of the five groups and assigning 
him to that group for which his likelihood is 
greatest. The statistical procedure for doing 
this is given by Rao (9), and in less advanced 
mathematical language by Lubin (7). By em- 
ploying it, it is possible to partition either the 
original test space, or, alternatively, the ca- 
nonical variate space between the groups. The 
calculations involved are heavy, but fortu- | 
nately, as shown in Eysenck’s paper (3), 
when only two variables are concerned the 
partitioning can be done satisfactorily by eye. 
Taking the original allocation to diagnostic 
categories as correct, lines radiating from a 
central point in the scattergram can be found 
which give a minimum of misclassification. 
For the sake of clarity, two scattergrams have 
been used here. Figure 3 contains the points 
for the normal, schizophrenic, and brain- 
damaged groups only, while Fig. 4 shows 
those for the depressive and brain-damaged 
groups only. 


BRAIN DAMAGED” 
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Fig. 2. Relative positions of the mean canonical vari- 
ate scores for the five groups. 


118 


canonical variate 2 


canonical variate | 
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Discussion of the Results 
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the canonica] Variates (Table 4 
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the other hand, th 
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Variate 1, for example, differentiates between 
two groups, we can draw no conclusion as to 
what result will be obtained when the same 
two groups are compared on Variate 2. 

A further advantage of obtaining the ca- 
nonical variates is that, whereas a four-di- 
mensional space would be required to locate 
our Ss if their scores on the four tests are 
used, the fact that only two latent roots bap 
found to be significant means that the ca 
nonical variates allow us to locate the Ss, 
without loss of information, in a slant 
sional space (see Fig. 2). The advantage thu 
achieved cannot be overemphasized. al 

Like factors in a factor analysis, roman) 
variates are, as seen from equation -a 
weighted measures of the test scores. f 
this reason there is a natural tendency j 
try to interpret canonical variates ayes 
logically, just as factors are interpreted. i 
tendency is not one to which the nyabat 
should succumb without due caution. For on 
thing, invariance of factors from one study tO 
the next is achieved by rotation, so that the 
factors rotated to a psychologically meaning- 
ful position are not wholly dependent upon 
the selection of tests used in the study. On 
the other hand, the weights used to define 
a canonical variate are unique to the atua 
in question and to the tests and groups p 
in that study. Moreover, these weights, ar 
regression weights in general, are known 
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vary notoriously from one study to another, 
especially so when the composition of the 
battery is altered. However, with this warn- 
ing in mind, it will be helpful when discussing 
the differences between our groups to give 
psychological labels to the two canonical vari- 
ates. For instance, canonical Variate 1, with 
high loadings on Tests 2 and 4, might tenta- 
tively be thought of as defining a normality- 
abnormality dimension, normals appearing at 
one extreme, neurotics in the middle, and the 
grossly abnormal groups at the other extreme. 
We have, however, no ready interpretation 
for the second canonical variate which is 


` heavily weighted on Tests 1 and 2. Defining 


this dimension poses a problem toward which 
future research may be directed. 

Now let us concentrate for a moment on 
Fig. 2. We may recall that the canonical 
variates, represented in it by the orthogonal 
axes, have the property of separating the 
group means from each other to the optimum 
degree. The mean points for the groups show 
that brain-damaged patients tend to have 
high scores on both canonical variates. Their 
mean is the most extreme of the means on 
both dimensions. 

On the normality-abnormality dimension, 
the mean of the brain-damaged group 0C- 
cupies the most extreme position at the 
“abnormal” end, with the schizophrenic and 
depressive groups next, their means not dif- 
fering significantly from that of the brain- 
damaged group. On the second dimension, the 
brain-damaged group mean together with the 
normal group mean are at one extreme and 
are opposed to the schizophrenic and neu- 
rotic group means at the other extreme 
with the depressives occupying an intermedi- 
ate position. More precisely, the brain-dam- 
aged group mean is differentiated, on the one 
hand, from the normal and neurotic groups 
means at a high level of significance (p< 
01) by canonical Variate 1, and, on the 
other hand, from the schizophrenic, neurotic, 
and depressive groups’ means (p again being 
less than .01) by canonical Variate 2. 

This would appear to be of value from a 
diagnostic viewpoint. Of importance, too, 1S 
the fact that whereas the normal Ss tend to 
have low scores on the ““normality-abnormal- 
ity” dimension, the situation is the reverse 


Table 4 


Significance of Differences Between the Groups on the 


Canonical Variate Scores 


F ratios 


Canonical Variate I Canonical Variate II 


21.73*" 10.226** 
t (2-tail) a 
Canonical Variate 
Groups compared I Ir 
Brain damaged v. normal 6.321"* 11379 
Brain damaged v. depressive 1.648 2.629** 
Brain damaged v. schizophrenic 1.868 o.740r¢ 
Brain damaged v. neurotic 3.0297 J42 
Normal v. depressive 3.429** 1:674 
Normal v. schizophrenic 3.87970 4932" 
Normal v. neurotic 2.195* 2.482* 
Depressive v. schizophrenic 0.001 2.340* 
Depressive v. neurotic 1.112 0.569 
Schizophrenic v. neurotic 1:222 1.824 


O 


* Significance of .05 or above. 
++ Significance of .01 or above. 


for the schizophrenic group, the means for the 
respective groups differing in each case be- 
yond the .001 level of significance. Indeed, a 
careful study of the ¢ test results shown in 
Table 4 indicates that the canonical variates 
enable us to distinguish all group means 
from each other significantly on one or other, 
or on both, of the variates with the exception 
only that the neurotic group mean can be 
differentiated on neither variate from those 
of the depressive and schizophrenic groups. 
However, the main purpose of this investiga- 
tion was to differentiate between the brain- 
damaged group on the one hand and the re- 
maining groups on the other, and this pur- 
pose has been realized. | 
Before going on to consider the identifica- 
tion of individual Ss, we might note that a 
more meaningful position of the variates 
might be accomplished by rotation to a po- 
sition approximately 45 degrees in a clock- 
wise direction. We might then preserve the 
“normality-abnormality” dimension, and em- 
phasize the interesting relative position oc- 
cupied by the brain-damaged group. Such a 
position, possibly reflecting qualitative dif- 
ferences between brain-damaged and other 
groups, psychiatric and normal, might sug- 
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gest fruitful lines along which further investi- 
gation could be directed. ; 
Differentiating groups, however, is not the 
same thing as diagnosing individual patients, 
and so we turn to the second aspect of our 
study (Figs. 3 and 4) which deals with the 
problem of classification, Ideally, the ca- 
nonical variate space should be partitioned 
into five distinct compartments, one for each 
group, in such a way that the number of mis- 
classifications is a minimum. This, as noted 
earlier, can be done efficiently by eye when 
the space is one of only two dimensions. How- 
ever, as the means of our neurotic group on 
the two variates are not differentiated from 
those of the depressive and schizophrenic 
groups—though the latter are differentiated 
from each other on Variate 2—it was de- 
cided, in the interest of clarity, to use two 
figures rather than one for classification pur- 


e ideal procedure. 
, the members of 
hrenic, and nor- 


Table 5 


Identifications Comparing Normal, 


Schizophrenic, 
and Brain-Damaged Gro 


ups 


Actual diagnosis 
se 


s n Schizo- Brain- 
Test diagnosis Normal phrenic damaged 

Schizophrenic 9 fa E 

Normal 36 4 $ 

Total 48 6 

Percentage correct 


H. R. Beech and A. E. Maxwell 


Table 6 


Identifications Comparing Brain-Damaged and 
Depressive Groups 


Actual diagnosis 


"a 


Brain- 
Test diagnosis Depressive damaged 
Brain-damaged 4 a 
Depressive 13 13 
Total 17 33 
Percentage correct 76.5% 


60.6% 


tween them are shown in Table 6. Here again, 
although the percentages of correct classifica- 
tions are fairly high, 13 out of the 33 brain- 
damaged Ss fall in the depressive compart- 
ment. Indeed, we must conclude that our 
efforts at differentiating the brain-damaged 
patients from the other groups, as seen from 
both figures, are not quite as successful as 
one might have hoped. The difficulty is due 
largely to the fact noted earlier that the vari- 
ance of the brain-damaged group on the sev- 
eral tests is greater than that of the other 
groups. This greater variation is reflected in 
the canonical variate scores with the result 
that, as seen in Figs. 3 and 4, the brain-dam- 
aged patients are widely scattered. 4 

It should be noted that scores on canoni- 
cal Variate 1 are related to intelligence in a 
way indicating that high scores on the for- 
mer are associated with low scores on the 
latter. As the brain-damaged group were 
found to be significantly less intelligent mpn 
the other groups (2), it is clear that some © 
the differentiation between this group an 
others might be a function of differences in 
intellectual status, Consequently, an anahi 
of covariance was performed on canonica 
Variate 1 scores, equating the groups for oi 
telligence level. This resulted in a genera 
slight reduction in Significance levels of dif- 
ferences between the groups. This procedure 
Was not necessary in the case of canonical 
— 2 which is not related to intelligence 
level. 


Summary 


Four measures of discrepancies in the re- 
Production of simple designs by drawing were 
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taken for each individual in five groups: nor- 
mal, neurotic, depressive, schizophrenic, and 
brain-damaged. In view of theoretical and 
practical difficulties encountered in differenti- 
ating satisfactorily between these groups on 
the measures, the technique of discriminant 
function analysis was applied to the data in 
the hope that the amount of misclassification 
would be reduced. 

The statistical model was briefly described 
and also the advantages in using the particu- 
lar technique chosen. 

In terms of levels of significance, the dif- 
ferences between the groups on the canonical 
variate scores were not strikingly superior to 
those obtained on the measures before ap- 
plying the statistical technique. It might be 
noted that a similar conclusion was reached 
by Beech (2) after comparing the number of 
subjects identified as belonging to one oF 
other of the groups under the two conditions. 
However, it was pointed out that certain dis- 
tinct advantages were to be gained by em- 
ploying the discriminant function method to 
the data, and it was clear that the test meas- 
ures combined in this way were clinically use- 
ful, especially where normals, schizophrenics, 
and prain-damaged subjects were concerned. 

A tentative interpretation of one of the two 
canonical variates was put forward. The sec- 
ond canonical variate presents a problem in 
i tion. 
a Vector 1 scores were found to be 
related to intelligence level, but it was re- 
ported that only slight reductions in the sig- 
nificance of differences between the groups 
resulted when the groups were equated for 


level of intelligence. 
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The Study 


The present study rests on a complete re- 
vision of Rapaport’s deviant response types. 
Powers re-evaluated Rapaport’s descriptions 
of his deviant response types, as well as the 
Rorschach responses which Rapaport lists as 
examples for each type of deviant response. 
As a result of this procedure, Powers isolated 
10 continua which seemed to be either ex- 
plicit or implicit in Rapaport’s material and 
which seemed to be relatively distinct and 
homogeneous. 

A short description of each c 
follows, with an extr 


tained in parenthes 
tions: 


ontinuum is as 
eme example of each con- 
es following the descrip- 


Continuum A Cohesiveness—Loosely integrated re- 


A room. [What makes it 
look like this?) Di 


the examiner, 
desert Picture . , 
desert picture conn 


VII, W. What is left of a bat, mashed 
up by a truck, part of it decayed.) i 
> Social acceptability—Tabog con- 
» Generally of a sexual nature, (Card Il, W. In- 
tercourse; glorified kiss.) l 
Continuum VI, Deterioration color—Go; 
sponses, (Card s 
almost gangrenous.) 
Continuum VII, 


TY color re- 
-Not a healthy color . . - looks 


Increase of distance—Any tend- 
ency to go beyond the blot with insufficient justifi- 
cation. (Card VI, W, each half. Li 


Helsingfors to Leningrad , Pe = sng fom 


kind of country; 


blot configuration, (Card IX, 


, ex organ (upper 
two-thirds), female these two (lower pink) 
Seem to be men looking at it.) 

Continuum IX, Threat. 


which shows 
e » Or fear, (Card VIII, upper middle 
space. Horrible face , - . - twitching lips.) 
Continuum X, Affect— 
or negative feelings towa; 
response. (Card IV. A hideous Picture.) 
Once the 10 continua had been isolated, an 
analysis of the characteristics of each con- 
tinuum suggested that they could readily be 


Combined into four large classes, Continua L 


and Roy M. Hamlin 


II, and III were combined to form Class A; 
intellectual disorganization; Continua IN; V, 
and VI were combined to form Class B, devi- 
ant content; Continua VII and VII were 
combined to form Class C, inappropriate a 
crease or loss of distance; and Continua D 
and X were combined to form Class D, affec- 
tive response. 


It was hypothesized that schizophrenics have _ 


a significantly higher or more pathological 
mean score on each of the four classes tha 
either normals or neurotics, and it was aa 
hypothesized that neurotics have a by, 
cantly higher mean score on each of the fo 
classes than normals, je 

No direct comparisons with the stu a 
using Rapaport’s deviant response types ni 
possible because of differences in method. 2 
direct comparisons will be made, howev A 
concerning the respective reliabilities and V 
lidities, 


Method 
Subjects 


Seventy-five Ss were used, 25 normals, 25 
neurotics, and 25 schizophrenics. All of the 
Ss were white, all were between 20 and a 
years of age, all had at least 100 IQ, and r 
gave at least 15 Rorschach responses. No 
was included in the experiment who did not 
meet all of these qualifications. k 

The three groups of Ss were equated pr 
sex, there being 11 males and 14 females F 
each group. They were also roughly equate 
for the variables of age, IQ, and education, 
with the schizophrenic Ss, as might be ex 
pected, being generally older than the nor 
mal and neurotic Ss and also having gener- 
ally less education and lower IQ ratings. 

All of the normal Ss were selected on the 


basis of adequate adjustment, with no his- 
tory of psychiatric t 
of psychiatric disabi 


to reality was somewhat 
hizophrenic Ss had bee? 
for periods ranging from one 
twelve years, with the diagnosis 
efinite for each case, 


year through 
being quite d 


| 
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Table 1 Table 3 
Distribution of Scores for Class A, Distribution of Scores for Class C, Inappropriate 
Intellectual Disorganization Increase or Loss of Distance 
Group Group 
oe S 
Schizo- Schizo- 
Score Normals Neurotics phrenics Score Normals Neurotics phrenics 
10.0 0 0 0 10.0 2 0 1 
10.0-10.9 18 19 1 10.0-10.9 16 6 7 
11.0-11.9 6 5 75 11.0-11.9 5 12 7 
12.0-12.9 0 0 1 12.0-12.9 2 6 3 
13.0+ 1 1 18 13.0+ 0 1 7 
Procedure judge following a period of training in the 


A scoring scale was drawn up for each of 
the 10 continua, ranging in five-point intervals 
from Point 10 to Point 50. Point 10 consisted 
of an absence of deviance with respect to the 
characteristics of each continuum, while Point 
50 consisted of extreme deviance with re- 
spect to the characteristics of each continuum. 
Point 30 and Point 50 of each continuum 
were anchored by five illustrative Rorschach 
taken almost entirely from Rapa- 
port’s examples. In addition, a description of 
the characteristic quality of each continuum 
was drawn up for the use of the scorers. 

One judge scored all 75 Rorschach records. 
Each response in every record received 10 
separate scores, one score for each of the 10 
continua. For the purpose of obtaining an 
estimate of scoring reliability five Rorschach 
records were chosen at random from each of 
the three S groups and these 15 Rorschach 
records were scored independently by a second 


responses, 


Table 2 


Distribution of Scores for Class B, 
Deviant Content 


scoring system. 

The four class scores for each S were ob- 
tained by averaging the scores of the two or 
three continua making up each class. 


Results 
Validity 


Tables 1, 2, 3, and 4 contain the distribu- 
tion of scores for each of the three groups of 
Ss for Classes A, B, C, and D respectively. 
These class scores were obtained by averag- 
ing the scores of the constituent continua. 

Table 5 gives the ż ratios obtained in the 
various intergroup comparisons, with one as- 
terisk indicating significance at the .05 level 
and two asterisks indicating significance at 
the .01 level. 

The significant differences contained in 
Table 5 were all in the predicted direction 
with the exception of the neurotic-schizo- 
phrenic comparison for Class D. The neurotic 


Table 4 


Distribution of Scores for Class D, 
Affective Response 


Group Group 

paisa Schizo- 

Score Normals Neurotics phrenics Score Normals Neurotics phrenics 
10.0 18 9 10 10.0 4 3 a 
10.0-10.9 7 15 12 10.0-10.9 14 10 7 
11,0-11.9 0 1 2 11.0-11.9 4 5 2 
12.0-12.9 0 0 0 12.0-12.9 3 5 i 
13.0+ 0 0 1 13.0+ 0 2 1 
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Table 5 


t Ratios Based on the Comparison of the Mean Score 
Values of Each of the Two Classes for 25 
Normal, 25 Neurotic, and 25 
Schizophrenic Subjects 


t Ratios 
Groups Class Class Class Class 
Compared A B G D 
Normal- 
Schizophrenic 5.59** 1.73 3.54** 1.35 
Neurotic- 
Schizophrenic 5.57** 1,14 1.81 2.35%* 
Normal- 
Neurotic 0.10 3.18**  3.76** 1.31 
* 01 level, 
group had a significantly higher mean score 
than the schizophrenic 8roup for this class, 
t may b 


; ion of total 
8toup, with the total Score for 


by summating the four 


Three intergroup 


. Comparisons 
using total scores a were made 


nd all three were signifi- 


Distribution of Total Scores, Usin, 


the S i 
Scores for All Four Classes fi r Fap ammation of 


or Each Subject 
Group 
E na 
& Schizo- 
ore Normals Neurotics Phrenics 
40.0 0 
40,0-41.9 7 : i 
42.0-43.9 14 11 
44.0-45,9 3 8 3 
46.0-47,9 1 2 
48.0-49,9 0 0 A 
50,0-++ 0 1 9 
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Table 7 
Intercorrelations of the Four Classes 
(N = 75) 
Class 

Class B c D 
A 65 65 —.09 
B 69 .03 
Cc 24 


cant at the .01 level. The ¢ ratios for the 
normal-schizophrenic, neurotic—schizophrenic, 
and normal-neurotic comparisons were, re- 
spectively, 4.05, 3.27, and 2.95. 

Table 7 contains the intercorrelations of the 
four classes. 

It may be seen from Table 7 that Classes 
A, B, and C have rather high intercorrela- 
tions, while the correlation of each of these 
three classes with Class D is negligible. 


Scoring Reliability 


Reliability coefficients were computed for 
the 10 continua and the four classes, For 
Continua I through X the reliability coeffi- 
cients were, respectively, .63, 37, 35, .08, .36, 
54, 33, 82, and .76; while for Classes A, B, 
C, and D the reliability coefficients were .57; 
-68, .81, and .89, 

Since each class was composed of two or 
three Continua, the correlation coefficients of 
the continua making up each class were aver- 
aged in order to find some explanation for the 
fact that the reliability coefficients for the 10 
Continua were not more imposing. These corre- 
lation coefficients were respectively for Classes 
A, B, C, and D, 46, .73, 44, and .79. These 
values are lower than the corresponding reli- 
ability Coefficients for three of the four classes, 
and Considerably so for Class C. These data, 
in combination with inspection of the scoring 
of the Tecords, indicate that the two scorers 
were fairly wel] agreed concerning the degree 
of deviance of responses with respect to eat: 

Class but that the two scorers were much less 


assigning responses to Continua I or II of 
Class A and Continua IX or X of Class D. 
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These differences were not extreme, however, 
and might well be lessened by a more succinct 
formulation of these continua. The two 
scorers, on the other hand, disagreed to a 
considerable extent in assigning responses to 
Continua VII or VIII of Class C. It seems 
clear that these two continua should be com- 
bined into one continuum, since duplication 
existed in the minds of the scorers if not in 
the descriptions of the continua. Logically, it 
is a simple matter to separate these two op- 
posed ways of responding to the Rorschach 
blots. In actuality, however, it is apparently 
much simpler for a judge to indicate that a 
given response deviates from the usual mode 
of responding to the inkblots to a greater or 
a lesser extent than it is for the judge to 
characterize this deviation as manifesting pri- 
marily “increase of distance” or primarily 
“Joss of distance” from the blots. 


Discussion 


In the previous studies (1, 3) making use 
of Rapaport’s formulations, the judges were 
obviously making use of general impressions 
obtained from Rapaport, since they agreed so 
little in assigning responses to specific scoring 
categories. The present study was based on 
the assumption that these general impressions 
could be isolated from Rapaport’s material, 
and the authors feel that the four classes of 
the present study represent the core of these 
i jons. ` 
tated earlier, no direct comparison is 

ossible with respect to validity and scoring 
reliability between the present study and the 
two previous studies which made use of Rapa- 
port’s deviant response types. This is so be- 
cause the present study does not make use of 
one overall score in determining validity and 
reliability but, instead, has broken the over- 
all score down into four large classes. We can 
make a validity comparison on the basis of 
optimal cutoff points, using the total score 
from Powers and Hamlin’s study (1) and 
using the single most effective class in each 
intergroup comparison in the present study. 
This comparison suggests the two methods 
are roughly equal in effectiveness 1n making 
the same intergroup discriminations. If we 
consider the distribution of total scores con- 
tained in Table 6, the present study is even 
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more effective comparatively, with a cutoff 
score of 46.0 correctly identifying 18 schizo- 
phrénic Ss and misidentifying, respectively, 
only one normal S and three neurotic Ss. 
Even more effective in discriminating between 
groups, however, is the combination of scores 
from Classes A and C for each S. In the lat- 
ter instance, a cutoff score of 24.0 correctly 
identifies 19 schizophrenic Ss while misidenti- 
fying only one normal S and two neurotic Ss. 
The scoring reliability coefficients in both 
Watkins and Stauffacher’s and Powers and 
Hamlin’s studies were highly significant and 
quite imposing in size. The scoring reliability 
coefficients of the four classes used in the 
present study were also highly significant. 
Furthermore, there is every reason to expect 
that these latter values can be increased by 
better delineation of the continua and the 
amalgamation of some of the continua. The 
set of categories developed in the present 
study seem to have greater potentiality for 
improvement than do those developed by 
Rapaport. Moreover, the four classes appear 
to have more psychological relevance than 
Rapaport’s categories, and these four classes 
concern four important and relatively non- 
overlapping aspects of Rorschach productions. 
The category of «intellectual disorganization,” 
for example, is much more communicable and 
self-evident in meaning than are categories 
such as “fabulized-combination” or “con- 
tamination.” Such obscure terms as the two 
latter ones tend to cast a pall of mystery over 
Rorschach interpretation and tend to isolate 
the Rorschach “magician” from those of his 
associates who prefer to deal with more con- 
crete terms. Furthermore, terms such as “in- 
tellectual disorganization” are much more 
amenable to statements concerning degree 
than are the previously mentioned terms, 
which almost seem bound to a “sign” ap- 
proach. May we be delivered from signs and 
the occult. 


Summary 


Rapaport’s material concerning deviant ver- 
balizations on the Rorschach test was ana- 
lyzed by one of the authors, and 10 continua 
were isolated, which seemed to be present ex- 
plicitly or implicitly in this material. An 
analysis of the characteristics of these 10 
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continua showed that they could be combined 
into four large classes, namely, intellectual 
disorganization, deviant content, inappropri- 
ate increase or loss of distance, and affective 
response. Scoring scales were devised for each 
of the 10 continua, and it was hypothesized 
that the scoring reliability Coefficients for each 
of the 10 continua woul 
cally significant, as w 
ability coefficients for 
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tance, significantly differentiated the normal 
group from the two patient groups. These two 
classes were the most effective classes in ef- 
fecting group differentiations. 

No direct comparisons are possible between 
the results of the present study and the re- 
sults of the two previous studies making use 
of Rapaport’s Categories because of the dif- 
ferences in methods, Indirect comparisons, 
however, Suggest that the present results are 
at least equal to those of the previous two 
studies insofar as scoring reliability and in- 
tergroup differentiations are concerned. Fur- 
thermore, the four classes isolated in the pres- 
ent study appear to have more psychological 
relevance and are more communicable and 
less occult than are the previous categories- 
Future studies are contemplated using the re- 
vised versions of the 10 continua. 
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Rorschach Concept Evaluation Test as a 
Diagnostic Tool’ 


Laverne C. Johnson 
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Skepticism of the reliability and validity of 
the clinician’s sensitivity in interpreting Ror- 
schach responses and the three to four hours 
needed to administer, score, and interpret a 
single protocol has motivated many to search 
for a quantitative score and a briefer form. 
The varjous quantitative and sign scoring sys- 
tems were reviewed by Knopf (3), and their 
ability to differentiate effectively among psy- 
choneurotics, psychopaths, and schizophrenics 
was tested. From his study, Knopf con- 
cluded, “For all practical purposes Rorschach 
summary scores cannot be regarded as ef- 
fective in differentiating among psychiatric 

roups” (3, p. 104). ; 

i Use k akn techniques has fared little 
better. As the interpretative hypotheses that 
form the backbone of the Rorschach tech- 
nique were developed on the basis of an indi- 
vidual test situation, the applicability of these 
hypotheses to responses obtained in groups 
(2). As a psychometric 
technique, group methods must rely for their 
interpretation upon statistically established 
differentiation among groups. Because of the 
difficulty in group testing of psychiatric pa- 
tients, especially schizophrenics, group norms 
for differential diagnosis are hard to obtain. 

The Rorschach Concept Evaluation Tech- 
nique (CET), though originally developed by 
McReynolds (4) to study perceptual differ- 
ences and psychopathology, permits the cal- 
culation of the quantitative scores sought by 
those who have eagerly grasped at the sign 
approach. Ease in administering the CET and 

1This study was supported in part by a research 
grant from the National Institute of Mental Health 
of the National Institutes of Health, United States 
Public Health Service. 


its brevity, about 15 minutes, also offer the 
possibility of its use as a screening technique 
in a psychiatric setting and yet it can be in- 
dividually administered. Essentially, the CET 
involves the presentation to the patient of 50 
specified Rorschach blot areas, each paired 
with a stated concept. The patient is then 
asked to decide whether the indicated areas 
could or could not represent the stated con- 
cepts. The patient is requested to answer Yes 
or No to each presentation, and his score is 
determined on the basis of his answers. The 
test and its development are described in de- 
tail elsewhere (5). In his article, McReynolds 
(5) elaborated on the clinical use of the CET, 
but made no attempt to evaluate its effec- 
tiveness as a diagnostic instrument for indi- 
vidual patients. McReynolds felt at that time 
that the CET could be best used as an ad- 
junct to the traditional Rorschach technique. 
While there is no question that the CET 
plus the Rorschach will give the most infor- 
mation, the purpose of this study is to in- 
vestigate the usefulness of the CET inde- 
pendent of the Rorschach. Specifically, how 
effective is the CET in differentiating among 
hospitalized psychoneurotics, sociopathic per- 
sonality disorders, and schizophrenics? In ad- 
dition, this study contributes data supporting 
the group norms reported by McReynolds. 


Procedure 


The patients in this study were all hos- 
pitalized at Malcolm Bliss Hospital, a city 
diagnostic and acute treatment hospital, and 
carefully examined by four psychiatrists ° for 


2 The psychiatrists were George A. Ulett, Eli Rob- 
ins, Kathleen Smith and Neil McCullough. 
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Table 1 
Mean Age and Mean IQ of Present Sample 


Age IQ a 

Group N M SD M SD 
par ae 15.00 

Paranoid schizophrenic 24 36.79 8.10 ae 14.16 
Schizophrenic other than paranoid 29 38.8 7.16 rf K 17.65 
Acute schizophrenic 21 30.31 8.21 ae 13.22 
Chronic schizophrenic 32 33.96 13.22 101.: 13.59 
Neurotics 34 31.22 8.67 103.76 12.52 
Sociopathic personality disturbance 27 28.35 5.76 103.50 a 


diagnostic discrimination in a larger study of 
(6). Three of the four psy- 


no sig- 


groups com- 
age or IQ. 


‘Ose of th 
Reynolds listed mea oo 


s in CET scores. 
this study are those re- 
tained by McReynold i 


concept; 
ment which reflects the i 
the patient applies h 


evaluation (as indicated by J) to the bee 
ous items in terms of the item criteria ie 
upon a normal sample; Æ, derived from af 
relationship of J and V; and R, number d 
Rorschach responses, if Rorschach was A 
ministered before CET. The T score conve 


Bee as 
sion table reported in the original study w4 
used in this study. 


> 
Results 


In Table 2 are listed the CET scores for 
McReynold’s study and for the present staon 
As the Rorschach was not administered to 4 
patients, the V for R, number of Rorschach 
Tesponses, is smaller than that for scores “ 
rived from the CET alone. Comparison 7 
group means in Table 2 reveals a high degre 


ire of similarity between the present data and 
Snificantly ho. 


se reported by McReynolds. Inspection of 


Table 2 also Suggests, and ¢ tests confirm, 
that there are 


Psychoneurotic a 
trait disorder g 
scores. These tw 
and referred to 
tients for compa 
tients. The sc 


nd the sociopathic persona 1P 
roups on any of the cen 
© groups were then combined 
as the nonschizophrenic pa 


hizophrenic group was ag 
agnosis, paranoid and non 
duration of illness. Patient 
S were of recent onset, x 
were called acute. Those Í 
Months were listed 45 
are the ¢ values for the 
scores with varom 
Stoupings. Values of ¢ for J and 
Scores do not Teach significance for any © 
T comparisons. The results indicate that 
neither the number of Concepts agreed to 00 


, ? 


tison with schizophrenic pa- 


e! 
no differences between th 


` 
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Table 2 
Comparison of McReynold’s Normative Data Mean Scores on the CET, with Present Sample 


Concept evaluation test score 


a F R E 
G 
toup N M SD N M SD N M SD N M SD 
McReynolds 
Paranoid 
schizophrenics 31 42.72 19.15 28 45.61 9.03 31 45.84 12.30 28 49.78 11.48 
Schizophrenics 
other than 
paranoid 34 48.21 2195 28 37.50 13.27 34 43.82 9.72 28 48.50 14.94 
Neurotics 34 46.65 9.88 34 50.82 7.64 34 44.06 7.88 34 53.18 8.10 
Johnson 
Paranoid 
schizophrenics 24 37.50 15.19 24 43.00 8.35 17 45.65 12.74 24 51.71 9.56 
Schizophrenics 
other than 
paranoid 29 45.34 13.56 29 36.41 10.80 21 40.71 12.92 29 43.86 11.61 
Neurotics 34 42.70 12.78 34 48.73 8.49 27 44.11 10.28 34 54.54 8.97 
Sociopathic 
8.04 21 45.48 10.90 27 51.88 8.32 


ersonalit 
Ho 48.52 


disturbance 27 43.15 10.36 27 


12 45.58 9.86 21 44.05 9.74 


Acute 

schizophrenic 21 41.42 14.86 21 34.15 10.42 

Chronic 

schizophrenic 32 42.75 15.99 32 42.50 10.46 24 41.50 13.37 32 48.81 13.00 


to fewer concepts on the CET than the other 
schizophrenic and nonschizophrenic patients. 
This difference was not statistically signifi- 


cant (p = -07). 


the CET nor the number of responses given 
on the Rorschach can be used to differentiate 
‘among the groups compared. It was expected 
that the paranoid schizophrenic would agree 


Table 3 
of CET Scores—t Values 


Comparison 
Concept evaluation test score 
Groups compared J E R E 
Total schizophrenic—Total nonschizophrenic 46 4.79*** 60 2.68** 
Paranoid schizophrenic—Nonschizophrenic h 1.54 2.69** 33 66 
Schizophrenic other than paranoid—Nonschizophrenic 1 6519" 1.20 3.53%** 
Paranoid schizophrenic—Schizophrenic other than 
paranoid j i Le 2.34* 1.17 2S2* 

Acute schizophrenic—Chronic schizophrenic -28 2.67** 98 141 
Acute schizophrenic—Nonschizopbrenic ,Ţ 42 5.35*** 32 345 
Chronic schizophrenic—Nonschizophrenic 10 2:11% 95 1.66 

*p = 05 level. 

wep = 01 level. 

+p = 001 level. 
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Consistency of judgment score, V, is the 
only CET measure that is significantly dif- 
ferent for all the groups compared. This 
difference for schizophrenics and nonschizo- 
phrenics is highly significant. If a V cutting 
score of 40 or below is used, only 9 (14.7%) 
of the nonschizophrenic patients receive scores 
below 40, while 31 (65%) of the schizo- 
phrenic groups receive scores below 40. 


Most of the schizophrenics who receive V 
scores above 40 are in 


Eighteen (56.2% 
ceive V scores ab 
of the acute case 
mal range, Thus, 
fairly sensitive in 
of judgment whi 
schizophrenics, 
schizophrenics, 
teristic of the a 
McReynolds 
ability of stand, 


may 
» behaviorally y 


the effectiveness 
the time of test- 
evaluate changes 


seems to be m 
of the patient? 


induced by therapy.® 
E, J minus V, was the least defined 

clinical scores by McR oari 

tively conceived as 


six months after admission showed a s 
crease in mean V scores, 

initially had V scores above 40, while three had V 
Scores of 40 or below at six months, These three 
Were the only patients still in the hospital at time 
Of retest, 


Laverne C. Johnson 


used again 38 (71.3%) of the schizophrenic 
group receive “normal scores.” However, only 
three (4.8%) nonschizophrenic patients re- 
ceived an E score below 40. Again like V, the 
E score seems to be highly diagnostic if be- 
low 40 but not too helpful if above 40. No 
particular pattern of low E scores seemed to 
be present except that patients who agree F 
a large number of concepts have loose stand- 
ards of judgment and are more likely to have 
a low V and thus a low E. This seems to z 
a consistent pattern which has been referre! 
to above as indicative of inadequate controle i 
Thus the E score adds little to the J or 
score interpretations. 

While no systematic study of mental de- 
fectives and organics was made because 0 
the small number of cases seen (N = 12); 
the scores from these groups, especially the 
V score, were similar to the schizophrenic 
group. Chronic brain syndromes (paresis Fo 
alcoholism) and patients with IQ below 6 
tended to have V scores below 40, These 


findings agree with those reported by Mc- 
Reynolds (5). 


Summary and Conclusions 


The Rorschach Concept Evaluation test 
has been investigated as a technique for ob- 
taining a quantitative score that might be 
useful in diagnosis and as a brief screening 
technique which could be individually a 
ministered. In the present study, data of 6 4 
carefully diagnosed schizophrenics andi Si 
neurotics were consistent with the origina 
norms reported by McReynolds for enan 
phrenics and neurotics. The effectiveness at 
the CET as a diagnostic tool independent © 


the Rorschach Was evaluated by comparing 
the clinical sco 


by schizophren 


nic group 
schizophrenic group 


of inconsistent standards. Acute 
nics had lower V scores ee 
chizophrenics and the V scores © 


schizophre 
chronic s 
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paranoid schizophrenics were not as low as 
other schizophrenics. The V score is felt to 
be useful in diagnosis, but its use as an indi- 
cator of the patient’s control at the time of 
testing regardless of diagnosis may be more 
important. The Æ score added little informa- 
tion beyond that given by the J and V scores. 


Received May 24, 1957. 
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Movement Responses and Creativity’ 


Dorothy Park Griffin 
North Carolina State Board of Public Welfare 


This study deals with the tendency of hu- 
man beings to perceive movement in suitable 
stimuli presented Pictorially in a static visual 
field. The well-known M response of the Ror- 
schach technique is the typical example of 


such a movement response. The behavioral 
correlates of M, accordin 


“more individualized in 
ative ability, more 
tive reactions, 
intensive than 


lationship bet: 
these behavio 
tivity. 


as elicited by 
ubin, referring 
ility conducted 


mathematical statisticians, and high 
school students, states that “all have failed 
to reveal any differences on Rorschach per- 
formance, and even tests especially designed 


to elicit movement have failed” (9). 
Procedure 


Using the Levy Movement Blots, a tech- 
nique devised by David Levy, with the ex- 


1 This research was done while the author was at 
Meredith College, Raleigh, North Carolina. 


press purpose of eliciting movement, two ex- 
periments were conducted with students in 4 
women’s liberal arts college to investigate = 
relationship between movement responses an 
creativity. 

Selected for the first study were 20 collega 
women rated as highly creative by at leas 
one teacher and two students and 20 others, 
matched in so far as possible in age, sex, year 
in college, and intelligence (measured bY 
ACE scores), who were rated by at least one 
teacher and two students as noncreative. AD 
effort was made to secure a sampling of cre- 
ative students from all major departments. 
However, the majority of the group judged as 
highly creative turned out to be majors in 
art, English, and home economics, while the 
noncreative group included no art or home 
economics majors and only two English ma- 
jors. a 

No formal rating scale of creativity was 
used, but heads of major departments were 
asked to select students judged to be ei 
inely creative, according to their owi siaaa 
ards and also in the light of Murphy’s de 
nition (3). Then they were asked to name 
several more whom they judged to be aver 
age in general ability but lacking in crea- 


tivity. Student raters were given the same 1n- 
structions. 


The mean age of the creative group was 


21.5 years and of the noncreative 21.2, range 


20-22 years. Sixteen of each group of 20 were 
seniors in colle i 


creative 


fully group because of highly su- 


perior ACE scores, it was decided to run id 
Second experiment in which the sample wou 
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be composed of the first two groups plus five 
additional highly creative subjects with su- 
perior ACE scores and five additional stu- 
dents judged as noncreative, matched ap- 
proximately for age and year in college but 
not for intelligence, since such matches 
seemed to be unavailable. In this way it was 
thought that something might be learned of 
the extent to which intelligence, as well as 
creativity, plays a part in the movement re- 
sponse. The mean ACE score for the five 
additional creatives was 132.6 as compared 
with 91.6 for the five additional noncreatives. 
The Levy Movement Blots were adminis- 
tered individually to each of the 50 women 
in the two studies, according to the directions 
in the Zubin Manual (8) and scored on the 
basis of 21 scales, including Levy’s three- 
step evaluation scale, the Zubin scales, and 
three scales devised by the author to measure 
Part B of the Levy, called the “phantasy 
test.” The examiners were seven psychology 
majors trained by the author. Each of the 
examiners first took the test herself and then 
spent several hours in group sessions with the 
author, scoring responses and discussing scor- 
ing problems. Later sessions were devoted to 
the recording and group scoring of a demon- 
stration test administered by the author. No 
statistical analysis has been made for ex- 
aminer errors, but the group had uniform 
training with ample opportunity for discus- 
sion of problems and for checking with other 
examiners and with the author on doubtful 
points. Further to minimize examiner errors, 
such as the halo effect, an effort was made 
to divide, as equally as possible, the number 
of creative and noncreative students tested 
by each examiner. Complete protocols of each 
subject were obtained for Parts A and B of 
the test, typed and scored by the student ex- 
aminer, and spot-checked by the author. 


Results 


The mean scores and differences, the stand- 
ard deviations and critical ratios on the 21 
movement scales were computed for the crea- 
tive and noncreative groups in the two stud- 
ies. Only one scale, “Control of Movement,” 
showed a difference significant beyond the five 
per cent level of confidence. On both studies 
this can best be interpreted as entirely nega- 
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tive. The method of “rank scores” as well as 
the ż test was used to measure the compari- 
sons. The two tests yielded the same results, 
even the probability levels being very close. 
The data were also analyzed by the chi-square 
method, which gave substantially the same 
results. 

Further to test the relationship of intelli- 
gence to differences on the movement scales 
between creative and noncreative groups, the 
ACE scores of each group of 25 were ranked 
and divided into high, medium, and low in- 
telligence subgroups. The range of the crea- 
tive subgroups was: high, 119-162; medium, 
91-115; low, 58-89; and of the noncreative 
subgroups: high, 110-141; medium, 86-110; 
low, 63-84. The means of each subgroup of 
creatives and noncreatives on the Control of 
Movement scale, on which a significant nega- 
tive difference had been obtained, were com- 
pared. The difference in each case was in 
favor of the noncreative group, i.e., negative. 

While the difference in ACE level was defi- 
nitely greatest in the high group of the crea- 
tives, the significant differences between crea- 
tives and noncreatives, on this scale, is found 
not at this level but between the medium in- 
telligence groups, where the ACE scores vary 
only a few points both in means and range. 
Thus it would seem that the significant dif- 
ference is quite independent of the intelli- 
gence factor. 

A comparison of the mean scores and dif- 
ferences of the group of 25 creatives on the 
21 scales was also made with a norm group 
of 100 women from the same college, se- 
lected at random from the various college 
classes and given the test during the follow- 
ing year by ten psychology majors, trained 
by the author, as previously described. No 
significant differences were found, but the di- 
rection of difference was negative as in the 
other studies. 


Discussion 


In general, these negative findings agree 
with those of Roe (4), Rust (6), and Zubin 
(9). The weight of experimental evidence 
seems to be definitely against the classic Ror- 
schach interpretation of M as signifying 
“more individualized intelligence” and greater 
creative ability. It becomes increasingly evi- 
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dent, as Burchard states, “that we cannot 
reach the secret of creativity by counting 
M’s” (1). In fact, Rorschach himself re- 
garded his work as experimental and sug- 
gested that his conclusions be regarded more 
as observations than as theoretical deduc- 
tions, since, as he wrote in 1911, “the theo- 
retical foundation for the experiment is for 
the most part still quite incomplete,” a state- 
ment which could well describe the situation 
today (2). 
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Apptoaches to Reliability of Projective Tests with 
Special Reference to the Blacky Pictures Test*’ 


Samuel Granick and Norma A. Scheflen 
St. Christopher's Hospital, Philadelphia, Penna. 


Reliability data are frequently sparse or ab- 
sent for projective tests. Twenty tests are re- 
viewed in Anderson and Anderson (2), but 
significant information on reliability is pre- 
sented for only four tests, preliminary findings 
for five, and no information for the remainder. 
Even where reliability has been reported in 
detail, incompleteness and uncertainty remain. 

Reviews by Macfarlane and Tuddenham 
(6) and by Ainsworth (1) point to a variety 
of difficulties in treating projective test data 
by statistical methods. One difficulty En 
development of objective scores which reflec 
the integrity or Gestalt of the personality. 
Without such scores subjective judgment must 
be resorted to, which moy confound test reli- 

ili ith judge reliability. A 
EE E problem, perhaps, is De 
relationship between test reliability and the 
stability of the personality. Since behavior is 
not usually consistent, marked poe ome P 
responses might be expected on repeated ad- 
ministrations of a test. The personality is as- 
sumed, however, to have a basic organization 
which should be reflected in the test responses. 
Reliability, therefore, may be expected when 
the clinical features are used as a basis for 


measurement. een 
The various attempts to study reliability 


1 This study was supported in part by a grant 
from the United States Public Health Service, Insti- 
tute of Mental Health. The authors gratefully ac- 
knowledge the critical and helpful assistance of the 
psychology staff of St. Christopher’s Hospital, Phila- 
delphia, Penna. Sincere thanks also go to the Board 
of Education, the Hunter, the Miller, and the Mc- 
Kinley Schools of Philadelphia for helpful coopera- 


ar d at the Eastern Psychological Associa- 


2 Presente 5: 
Bae ing at New York, April 12, 1957. 


of projective tests seem to direct attention to 
these problems rather than to solve them. 
Since validity implies reliability, the sugges- 
tion has been made to emphasize the validity 
of the test, thus, in effect, bypassing the prob- 
lem (6). Another suggestion is to determine 
the limits within which the test is reliable 
by delineating the aspects of the test data 
which are unreliable because of such factors 
as the testing environment and the mental 
set of the subject (1). 

The present authors feel that a direct at- 


‘tack on the problem of reliability is possible. 


It is suggested that aspects of reliability which 
involve clinical features of the test be sought. 
The demonstration that many of these ele- 
ments are reliable would make it reasonable 
to place confidence in the test’s stability, at 
least, within a clinical framework. 

The above approach is illustrated in a se- 
ries of reliability studies conducted as part of 
a more general research on the usefulness of 
the Blacky Pictures Test for children. It was 
found possible to make use of three traditional 
measures of or approaches to reliability. These 
were (a) judgment reliability or the extent to 
which the scorers agree, (b) temporal reli- 
ability or the extent to which the test-retest 
scores are consistent, and (c) internal reli- 
ability or the extent to which split halves are 
consistent. 


Subjects 


The Ss were grade school pupils, 28 girls 
and 12 boys, whose ages ranged from six 
years, six months to eleven years, three 
months. Their IQs on the Revised Stanford 
Binet, Form L, ranged from 81 to 127. All Ss 
had been evaluated as being well-adjusted by 
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Table 1 


Percentage Agreement of Judges in Rating Spontaneous 
Story (Strong or Weak) of Each Card 


(N = 40) 

Card % p Value 
No. Agreement (Binomial) 

I 75 01 

IL 58 34 
II 90 .001 
IV 70 OL 

Vv 83 -001 
VIA* 83 001 
VIB 80 001 
VIL 68 05 
VII 73 01 
Ix 60 21 

x 95 .001 
XI 95 .001 


* Çard VI was scored twice, A for “castration anxiety,” B 
for “penis envy.” 


means of teacher ratings and clinical judg- 
ments prior to the administration of the 
Blacky Pictures Test. All testings, including 
the administration of the Blacky, were on an 
individual basis. Twenty Ss (Group A) had 
a second administration of the Blacky three 
months to one year later, The other 20 Ss 
(Group B) were selected from a larger group * 
and were individually matched to Group A 


for age, sex, IQ, and socioeconomic level. The 
mean age for Gi 


Judgment Reliability 


Reliability of scores is basic to the use 
of any test. With projectives, there has fre- 
quently been the problem of devising a scor- 
ing system which abstracts the data in a clini- 
cally meaningful and reliable fashion. Since 
totally objective scoring generally proves diffi- 
cult or impossible to devise, reliability of scor- 
ing, in effect, is dependent on the reliability 

3 This larger group consisted .of 88 Ss, selected from 
the Philadelphia public schools, to be used in a se- 
ries of studies of the Blacky Pictures Test. Each 
child was considered well-adjusted as rated by his 
teacher and was further judged well-adjusted by a 
clinical psychologist before the Blacky was adminis- 
tered, 


of judgments. In the case of the Blacky, Blum 
(3) suggests a rating of “strong” or “weak” 
as one type of score for the emotions elicited 
by each of the pictures or personality dimen- 
sions alleged to be tapped by the test. Ac- 
cordingly, the following hypothesis suggests 
itself. Judges agree on the scoring of the spon- 
taneous stories of the Blacky Pictures Test. 
Using the criteria for scoring “strong” or 
“weak” proposed by Blum, with modifications 
by Hilgeman (5), Winters (7), and the 
writers, each of 10 judges rated the stories of 
two cards for the 40 Ss of Groups A and B. 
The validity or clinical significance of scoring 
was not in question. Merely considered was 
the extent to which the test stories could be 
scored by this system in a consistent fashion. 
Table 1 shows the percentage of agreement 
of the judges for each card. That agreement 
is better than chance is supported at less than 
the .05 level of confidence for all but two of 
the cards, the majority of p values being .01 
or less. It should be noted, however, that only 
three of the eleven groups of judgments show 
agreement of 90 per cent or over. The results 
suggest that consistency of scoring may be 
achieved but that improved concreteness of 
scoring criteria needs to be developed. 


Temporal Reliability 


As suggested earlier, repeated administra- 
tions of a projective test to the same S over 
a period of time are not expected to produce 
the same responses, but they should reflect 
the stable components of the personality. De- 
spite the undefined nature of the components, 


Table 2 


Percentage of Correct Matching Between Two 
Test Administrations to Same Ss 


Judge N % Matching p Value" 
1 6 100 001 
2 6 100 001 
3 7 43 07 
4 7 14 37 
5 7 100 001 
6 7 72 001 
7 7 72 001 
8 7 57 02 


_* This value was determined by a direct application of prob?“ 
bility theory as suggested by Feller (4, pp. 62-66). 
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Table 3 


Judge Agreement in Rating Similarity of Thematic 
Content for Two Test Administrations to 
Same Ss and for Single Administra- 
tions to Matched Ss (N = 40) 


Card % p Value 
No. Agreement (Binomial) 
I 70 02 
I 73 01 
I 68 05 
IV 60 21 
¥ 78 001 
VI 75 .01 
VI 65 06 
VIII 75 01 
Ix 55 52 
X 88 .001 
XI 83 .001 


reflections or indirect indicators may be used 
to evaluate the reliability of a test. In the 
present study, three hypotheses were tested 
as an approach to the clarification of this 
principle. ; 

Hypothesis 1. Blacky Test records obtained 
at different times with the same Ss can be 
matched. The Blacky protocols of the 20 Ss 
of Group A who had been tested twice over a 
period of three to twelve months were di- 
vided into three sets, one of six boys and two 
of seven girls, Two judges matched the set of 
six, and three judges matched each of the sets 
of seven. Matching was done on a gross basis, 
permitting the utilization of a variety of clues 
such as language, story content, and a 
tional patterns. The judges were informed, 
furthermore, of the sex of the Ss. 

All matchings but one were beyond chance 
expectation as shown in Table 2. Perfect 
matching was obtained in only three of me 
seven matchings. It appears, however, tha! 
there was sufficient temporal consistency n 
the Ss’ responses generally to enable five a 
the eight judges to recognize which records 
belonged together. 

Hypothesis 2. Thematic content of on 
taneous responses to each of the Blacky Pic- 
tures is more frequently similar for the ay 
Ss on repeated test administrations than = 
a group of Ss and their matched controls. The 
Spontaneous stories from the two sets of 
Blacky protocols of Group A and those ob- 


tained from Group B were used to test this 
hypothesis. Two judges evaluated the the- 
matic content of the three spontaneous stories 
presented for each of the 11 Blacky cards. 
Judgments were then made as to whether the 
stories or responses were similar to or differ- 
ent from each other. For the guidance of the 
judges, it was suggested that they consider the 
manifest rather than the implied content in 
determining whether any two stories were 
similar to each other. 

Agreement between judges is presented in 
Table 3. There would seem to be only fair 
consistency between the judges, but yet the 
overall pattern is one of greater than chance 
agreement. To test the hypothesis, a paired 
t was computed for the differences between 
the number of stories judged similar (¢ equals 
7.25). The hypothesis is supported at the .001 
level of confidence. 

The finding points to the overall trend in 
the direction of significantly greater similar- 
ity of thematic productions between the two 
administrations of the test to Group A than 
between the single administrations to Groups 
A and B. Despite the much better than chance 


Table 4 


Percentage of Similarity of Thematic Content Be- 
tween Two Test Administrations to Same 
Ss and Between Single Adminis- 
trations to Matched Ss 


Ss Pair No. Same Ss Matched Ss 
1 55 32 
2 50 23 
3 77 36 
4 86 32 
5 55 41 
6 45 50 
7 36 18 
8 82 27 
9 59 36 

10 77 41 
11 77 27 
12 73 59 
13 63 50 
14 50 41 
15 50 5 
16 50 27 
17 50 32 
18 77 41 
19 68 41 
20 23 18 
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Table 5 


Consistency of Likes and Dislikes of Particular Cards 
for Two Administrations to Same Ss 


(N = 20) 

Card Same p Value 

No. pref. (Binomial) 
ie 15 001 
Tr 15 001 
Il 14 .001 
IV 14 001 
Vv 17 001 
VI 19 001 
vil 15 001 
VII 14 .001 
IX 16 .001 
xX 14 .001 
XI 17 .001 


result, it should be noted that the amount of 
consistency in thematic productions by the 
individual § is not very high, as shown in 
Table 4. 

Hypothesis 3. Ss are consistent in their 
likes and dislikes for individual cards over a 
period of time. The preferences or “like” and 
“dislike” choices for the two sets of Blacky 
protocols of Group A were compared. Table 5 
shows the extent to which each § placed the 
individual cards in the same category for the 
two administrations of the test. Marked con- 
sistency is evident in the choices, supporting 


the hypothesis at the .001 level of confidence 
for each card, 


Internal Reliability 


The writers recognize that a split-half ap- 
proach to reliability tends to destroy the 
global quality of a projective test. Neverthe- 
less, it seems feasible to consider the data in 
terms of specific, clinically meaningful dimen- 
sions which can be evaluated through a sam- 
pling of the test responses of the individual 
Ss. Such an approach serves to Maintain the 
overall unity or Gestalt of the test record and 
yet permits its division into two approximately 
similar halves. Along these lines the writers 
attempted to study the test’s reliability with 
regard to (a) verbal fluency as Measured by 
the number of words in the spontaneous 
stories, and (6) organization as reflected 
through the use of the central theme of each 
picture. 


Hypothesis 1. The verbal fluency of Ss is 
consistent within the Blacky Test. 

The number of words for each spontaneous 
story of the 40 Ss (the first test administra- 
tion of Group A and the records of Group B) 
was counted. The total of each S on Cards 2, 
4, 6, 8, and 10 was compared with his total 
for Cards 3, 5, 7, 9, and 11, Card 1 being 
omitted because of the uncertain effect of its 
unique position in the series. The rank-order 
correlation between the two halves was .92, 
which is significant at the .01 level of con- 
fidence. The similarity of fluency between the 
two halves of the test is also reflected in the 
means and standard deviations (mean of 2-10 
equals 184 words and SD equals 107; mean 
of 3-11 equals 178 words and SD equals 129; 
# equals 0.64). 

Hypothesis 2. In organizing their spontane- 
ous stories, the central theme of each card 
will be used in a consistent fashion by the Ss. 

The same division of the test as described 
above was used. Two judges scored each story 
of the 40 records as to whether it was “struc- 
tured” (utilized the central theme of the pic- 
ture) or “unstructured” (failed to use the 
central theme of the picture). Agreement be- 
tween the judges was 100 per cent. The phi 
coefficient of correlation between the two 
halves of the test was found to be .67, which 
is significant as the .01 level of confidence. 


Discussion and Conclusions 


The results reported do not represent high 
level reliabilities, but since they are uniformly 
in the same direction they command some re- 
spect. Accordingly, the Blacky Pictures Test 
would seem to have a significant degree of re- 
liability when used with a group of children.‘ 
Of perhaps greater interest, however, are the 
implications derived from the approaches used 
for the study of reliability, The concept of a 


4 Since there is a five-year age span in the group, 
and test responses are expected to differ with age 
the question arises as to the effect of the age factor 
on the reliability results obtained, The small sample 
and design of the study, unfortunately, did not per- 
mit an adequate control for age, Inspection of the 
data, however, reveals no marked differences in cor- 
sistency of response patterns between the older and 
the younger Ss. This, of course, is not a definitive 
answer to the problem. Further study of the age 
factor is in order. 
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continuing study of a test’s reliability is sug- 
gested. What seems required is that many as- 
pects of the test should be investigated over 
a period of time and under varying circum- 
stances. In this fashion, there is a gradual ac- 
cumulation of data clarifying the nature of 
the test’s stability. Since an overall “coeffi- 
cient of reliability” for a projective test does 
not seem to be feasible, this approach might 
represent a reasonable alternative. ` 

From a clinical standpoint, there are ad- 
vantages to such an approach. Data are pro- 
vided which throw light on the significance of 
test results obtained under varied circum- 
stances. Thus, the objectivity of interpreta- 
tions and judgments is improved. Since hy- 
potheses, such as those tested in this study, 
tend to be related to qualities of the test gen- 
erally given attention in the clinical situation, 
the clinician can more easily differentiate the 
stable aspects of the test performances from 
those which are a function of the immediate 
situation. 

In all, the present study attempts to sug” 
gest that the traditional concepts of reliability 
need not be abandoned in dealing with pro- 
jective materials. Some broadening of the in- 
terpretation of the concepts is called for. Also 
necessary is the adaptation of the test data to 
available statistical or analytical techniques, 
but with care being exercised to preserve the 
Clinical entity of the responses being studied. 


Summary 


In this study, the feasibility of pe ire 
reliability measures of projective tests base 
on the clinical aspects of the test material is 
considered. Using data obtained with the 


Blacky Pictures Test on 40 school-age chil- 
dren, several hypotheses are explored related 
to judgment, temporal, and split-half reli- 
abilities. 

The data are analyzed with a view to main- 
taining the global or clinical quality of the 
test responses. Evidence is derived which sup- 
ports the test’s stability to a modest degree. 

Attention is given, in addition, to the diffi- 
culties of deriving an over-all “coefficient of 
reliability” for projective measures: This study 
indicates that integration of varied approaches 
to a test’s consistency may serve as an ap- 
propriate alternative. 


Received May 6, 1957. 
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Personality Correlates of Q-L Differentials 
on the ACE'? 


B. Spilka 


University of Denver 


and Gloria Kimble 


Washburn University 


In 1952, Altus (1) empirically attempted 
to determine correlates of intellectual varia- 
tion in a population of women students. Be- 
cause of the empirical nature of this work, 
the authors felt it desirable to verify and ex- 
plain Altus’ findings further. 

Altus item-analyzed certain MMPI items 
against ACE Q — L differentials. Of the 566 
items available, 43 met his criterion of selec- 
tion, but only 26 attained statistical signifi- 
cance at the .05 level. 

Nine categories of 3 to 8 items were then 
Constructed, and descriptions of the subjects 


In the present study, 87 women students 
at Washburn University served as Ss, Each 
was administered the ACE, the complete 
MMPI, the Thurstone Scale of Religious 
Orthodoxy, the Taylor Manifest Anxiety 
scale, the F scale, the Siegel Manifest Hos- 
tility scale, and measures of Behavioral, Feel- 
ing-Tone, and Somatic manifest anxiety de- 
veloped by Spilka and Siegel. 

The MMPI Mf scale was used to assess 


1The authors would like to express their thanks 
to E. D. Turner for his statistical help. 

2 An extended report of this study may be ob- 
tained without charge from Bernard Spilka, Depart- 
ment of Psychology, University of Denver, Denver 
10, Colorado, or fer a fee from the American Docu- 
mentation Institute. Order Document No. 5468, re- 
mitting $1.75 for microfilm or $2.50 for Photocopies. 


Altus’ categories of sexual inversion and im- 
maturity, and masculine-feminine vocational 
preferences. The Orthodoxy scale, the F scale, 
and the MMPI Pd scale appeared to corre- 
spond closely to Altus’ “religiose” and “rose- 
colored glasses” items. The MMPI Pt scale 
was considered a measure of the Ss’ obsessive- 
compulsive tendencies. 

The MMPI Hs, D, and Hy scales, plus the 
4 scales of manifest anxiety, were used to 
assess Altus’ “anxiety” syndrome. The “so- 
cial sensitivity” category was measured by 
the MMPI Si scale and the Behavioral Anx- 
iety scale. Altus’ “resentful attitudes” cate- 
gory was assessed by the MMPI Pd scale 
and the Manifest Hostility scale, 

Only 6 of Altus’ items now satisfied his ac- 
ceptance criterion and only 2 were signifi- 
cant at the .05 level. Neither of these items 
satisfied the acceptance criterion, and only 
one of them was significant in Altus’ study. 
None of the correlations computed to assess 
the validity of Altus’ categories attained sig- 
nificance. 

It was found that 30 of the 43 items ex- 
hibited scoring tendencies in agreement with 
those obtained by Altus. The correlation be- 
tween the 43 items and the differentials was 
-22, revealing significance at the .05 level, 
and supporting Altus? “modicum of validity” 
claim. Where it lies and what comprises it re- 
mains unknown, 

It is recommended that further work in 
this area be conducted on a theoretical rather 
than an empirical basis. 

Brief Report. 
Received November 19, 1957, 


Reference 


1. Altus, W. D. Personality correlates of Q — L vari- 


ability on the ACE, J. consult. Psychol., 1952; 
16, 284-291. 


142 


r 


Journal of Consulting Psychology 


Vol. 22, No. 2, 1958 


Learning in Aphasic Patients*- 


Leo Katz 
VA Outpatient Clinic, Brooklyn, N. Y. 


Aphasic disturbances are generally defined 
as impairments of language functions due to 
brain damage, either through cerebro-vascular 
accident or external injury to the brain. The 
extent to which other mental functions are 
impaired in aphasia is a subject of consider- 
able controversy. , ‘ 

This study attempted to investigate the 
presence of certain learning deficiencies in 
aphasic patients often described by sare 
therapists (6, 8, 10). These workers repor 
that frequently a patient may be unable $ 
repeat a phrase or word he has just hear! 
when he is asked for it, but that sometimes, 
when he is not asked for it, or when he is per- 


mitted or encouraged to use roundabout meth- 


ods, he may be able to furnish the material 


previously learned. Similar observations ne 
reported by Conrad (1), who studied a a S 
of predominantly expressive aphasics = Eir 
word-finding difficulties. He explaine i 
impairment as an inability to stuci E 
conceptual field, so that peripheral er s. 
from the background of the Gestelt lt 
fered by the patient as his best ee 
to the “final” and inaccessible figure, t 2 
itself, To facilitate recall in such patients, 
advocated that they be encouraged 2 ae 
whatever peripheral or tangential é a 
are available to them in their efforts he 
rive at the desired solution. To some son a 
this roundabout method of recapturing Saa 
forgotten material is also used by non- 
dissertation submitted 


1 This paper is based on a a philosophy 


in candidacy for the degree of doctol 0 Fhe writer 
ji ersity. 
at Teachers College, Columbia pay eE fie Te 


is indebted to members of his thesi È Ai 
Skabe Jr. P. E. Eiserer, Virginia M. seen haa 
H. Solomon for their suggestions and ene See ot 

2 Presented to the twenty-sixth mannat ee 
the Eastern Psychological Association, š 


Pa., 1955. 


injured people when trying to remember 
names or dates (3). 

Thus, under certain conditions, making an 
effort or concentrating on a task does not seem 
to result in more efficient performance than is 
obtained in the absence of such self-direction. 
The present investigation was undertaken to 
determine whether aphasics exhibit the usual 
gain in efficiency of recall which results from 
the intention to remember as compared with 
the absence of such an intention. 

Traditionally, learning has been found to 
be better with goal-directed than with inci- 
dental instructions. It seems obvious that a 
person making an effort to learn will perform 
more adequately than one not making such 
an effort. The hypothesis of the present study, 
accordingly, is that goal-directed learning, as 
compared with incidental learning, is signifi- 
cantly more efficient for nonaphasics than for 
aphasic patients. 


Method 


The material to be learned consisted of two 
series of 20 postage stamps (Series X and Y), 
which were exposed to the subjects (Ss), one 
stamp at a time for five seconds each. In the 
incidental learning situation, one series of 
stamps was exposed with instructions to 
evaluate the stamps aesthetically (“tell me 
whether you like it or not”). After all of the 
20 stamps had been shown, they were mixed 
with a group of 40 other stamps which the S 
had not been shown and he was asked to pick 
out all the stamps he could remember. The 
learning score was the number of stamps cor- 
rectly selected minus one-half the number of 
stamps incorrectly selected. 

In the goal-directed learning situation, 
which always followed the incidental learn- 
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ing situation by about 24 hours, the Ss were 
shown the other series of postage stamps, one 
at a time for five seconds each, this time with 
instructions to remember them so as to be 
able to select them afterwards from another 
group of 40 stamps. The learning score again 
was calculated in the manner described previ- 
ously. 

The difficulty of the task depended in part 
upon the degree of similarity between the 20 

‘stamps to be remembered and the 40 stamps 

from which the 20 had to be selected. At- 
tempts were made to equate this degree of 
similarity in both series, In order to deter- 
mine the equivalence of the two series, they 
were administered to a normative group of 18 
Ss with goal-directed instructions only. The 
Means and standard deviations of the scores 
obtained under these conditions were essen- 
tially equivalent. The split-half reliabilities of 
the scores of the normative group were r = 85 
for Series X and r= .g9 for Series Y, after 
_the Spearman-Brown Correction. 

Stamp Series X and Y were alternately ad- 
ministered to successive Ss, €g, S #1 might 
have Series X administered with incidental in- 
structions and Subject #2 would then have 
Series Y administered with incidental instruc- 
tions. Thus, any difference obtained with goal- 
directed and incidental instructions were prob- 


ably not due to differences in difficulty be- 
tween the two stamp series, 


one clinic which co 
Stamp collectors 
study. 


The experimental group consisted of 25 na- 
tive white male patients between the ages of 
19 and 51 who were being treated for aphasia 
and right hemiplegia due to either cerebro- 
vascular accident or traumatic injury to the 
brain. All of the aphasics were being given 
language retraining and had been Classified 

3 The writer is indebted to the staffs 


rology and psychology services of th 
Hospital, the Bronx VA Hospital, 


of the neu- 


by the language therapists as predominantly 
expressive. No acutely aphasic patients were 
included in the group. 

The control group consisted of 25 native, 
white male patients between the ages of 19 
and 48 from the surgical wards of a Veterans 
Administration hospital. Patients with his- 
tories of psychiatric conditions, gastric or 
duodenal ulcer, or essential hypertension were 
excluded. The patients were tested postopera- 
tively and each name was first submitted to 
the physician in charge in order to eliminate 
those with postoperative complications. 

A comparison of the mean age and educa- 
tion of the Ss indicated that the two groups 
were essentially homogeneous with respect to 
age and education. The two groups were found 
also not to differ significantly in sociocultural 
status, as measured by occupational level with 
the Goodenough Anderson Occupational Rat- 
ing Scale (5). 


Results 


The hypothesis states that goal-directed 
learning as compared with incidental learn- 
ing is more efficient for nonaphasics than for 
aphasics. To test this hypothesis, the mean 
recall scores for each type of learning were 
compared within each of the two groups. 

For the nonaphasics, the mean recall score 
for incidental learning was 10.66 with a stand- 
ard deviation of 3.88. The mean recall score 
for goal-directed learning was 13.12 with a 
standard deviation of 2.55. The correlation 
between recall scores obtained with incidental 
and goal-directed instructions was .6135. A 
t test applied to the difference between the 
mean scores yielded a ¢ of 3.93, which was 
found to be significant beyond the .001 level. 
These results indicated that nonaphasics per- 
formed significantly better with goal-directed 
than with incidental instructions, 

For the aphasics, the mean recall score for 
incidental learning was 9.92 with a standard 
deviation of 3.17. The mean recall score for 
goal-directed learning was 9.06 with a stand- 
ard deviation of 3.24, By inspection of the 
mean scores it is apparent that the aphasics 
did not earn a higher recall score with goal- 
directed instructions, Their mean recall score 
with goal-directed instructions is lower than 
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the mean score earned with incidental instruc- 
tions. These results support the hypothesis. 

In order to determine whether the differ- 
ence between recall scores obtained by the 
aphasics was significant, a ¢ test was applied 
to the difference between the mean scores. 
The correlation between incidental and goal- 
directed scores was .7167. The ¢ of 1.76 which 
resulted from this analysis, indicated that the 
difference was not significant. 


Discussion 


The results of the experiment show that 
goal-directed instructions, as compared with 
incidental instructions, produced higher re- 
Call scores in the nonaphasics but not in the 
aphasics. What is the explanation for the lack 
of improvement in the scores of the aphasics 
despite their knowledge of the task expected 
of them? «riadi 

One possible explanation for this failure to 
profit from the goal-directed set may be the 
aphasic’s relative inability to retain or main- 
tain the set induced by the goal-directed in- 
structions with sufficient consistency to per- 
form more adequately. Such a notion is con- 
sistent with studies of brain functions in both 
animals and humans which report increased 
distractibility in the performance of brain- 
injured Ss (4, 7, 9). The psychological proc- 
esses responsible for this increased distracti- 
bility in the human Ss, while gma 
specify, may be related to deficiencies i e 
use of implicit verbalizations or cue-pro ne 
ing responses. Implicit verbal cues tend to be 
employed for “rehearsal” of the rpne a 
when the task becomes complicated. In suc 
Circumstances, one may quickly “run tbrough 
the steps” of a demanded activity to m e 
sure one understands the task. The goal-di- 
rected learning task in the present study was 
Purposely made simple in order to Tie 
interferences which might result from t A 
possible inability to maintain the set induce 
by instructions. ; 

Another, and more far-reaching epla an 
for the aphasic’s relative inability to Pro 4 
from knowledge of the goal may be telag 
to the aphasic’s drive state when confronte 
with the need to solve a problem. Aphasics 
have a high degree of experience with failure. 
Not only are they handicapped with respect 
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to the use of language, they also suffer from 
severe restrictions in the use of their limbs 
(many aphasics are paralyzed on one side of 
the body). Thus, they experience repeated 
failure in ordinary motor situations, in the 
process of communication and in social rela- 
tionships which characteristically depend upon 
speech proficiency. It was thought, therefore, 
that as soon as aphasics are made aware of 
a new expectation of achievement, their his- 
tory of experience with failure might reacti- 
vate anxieties which inhibit their deriving the 
same benefit from a goal-directed learning 
situation as nonaphasics can. 

This notion of the inhibitory effects of anx- 
iety is consistent with Goldstein’s (4) theory 
of the organic patient’s inability to cope with 
a problem as the determinant of his cata- 
strophic reaction. Undoubtedly, the anticipa- 
tion of this inability to cope, or the memory 
of previous failures, can serve to evoke or to 
perpetuate the feelings of anxiety which may 
have interfered with a more efficient perform- 
ance of the aphasics in the goal-directed 
learning situation. 

Either one of the two explanations offered 
can account for the data, but it is also pos- 
sible that both of them are applicable. It is 
possible, for example, that anxiety due to the 
reactivation of previous experiences with fail- 
ure may have made it more difficult for the 
aphasics to retain the set induced by the in- 
structions. 

In the present experiment, it was not pos- 
sible to observe directly the drive state of the 
Ss or even to subject it, indirectly, to some 
measurement procedure. It might be of inter- 
est, however, to note that one of the aphasics 
repeatedly requested that he be permitted to 
terminate the goal-directed learning situation, 
although he had made no such request on the 
previous day in the incidental learning situa- 
tion. 


Summary 


The study investigated the relative effec- 
tiveness of goal-directed and incidental learn- 
ing in aphasic patients. Observations about 
the performance of aphasics made by differ- 
ent workers were the source of the hypothe- 
sis which stated that in aphasic patients the 
normally more effective goal-directed learning 
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situation is not significantly more effective 
than the incidental learning situation. In or- 
der to test this hypothesis, two equivalent se- 
ries of postage stamps were exposed to 25 
predominantly expressive male aphasic pa- 
tients between the ages of 19 and 51, once 
with instructions to remember the stamps and 
once with instructions to evaluate the stamps 
aesthetically. Retention of the material was 
tested and the scores obtained by the aphasics 
were compared with those obtained by a con- 
trol group of 25 male nonaphasics. Results 
confirmed the hypothesis. 


Received May 7, 1957. 
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Wechsler-Bellevue Scatter as an Index of Schizophrenia 


Arnold Trehub and Isidor W. Scherer 
VA Hospital, Northampton, Mass. 


Numerous studies have been reported which 
have used some measure of scatter on the 
Wechsler-Bellevue as a basis for clinical diag- 
nosis. The recent review by Guertin, Frank, 
and Rabin (2) summarizes the yield to date 
as “inconclusive.” The criticism has been of- 
fered that instances where good agreement 
has been found between psychiatric and W-B 
diagnoses may be “due to the inspectional 
techniques of the clinician rather than the 
numerical scatter values” (4, p. 229). Fur- 
thermore, it is held that while W-B scatter 
may successfully differentiate groups in terms 
of a statistically significant difference, it has 
not been demonstrated to be effective in the 
diagnosis of individuals. ; 

The present study dealt with the individual 
discrimination of schizophrenics from neu- 
rotics and character disorders on the basis of 
a scatter index computed directly from W-B 
subtest scores. 


Procedure 


The sample consisted of a random selection 
of male patients in a Veterans Administration 
neuropsychiatric hospital who held a psychi- 
atric diagnosis of schizophrenia, neurosis, or 
character disorder, who had been referred for 
Psychological testing and who had been ad- 
ministered a complete (11 subtests) W-B 
Form I. The scatter index used involved sheer 
Variability of subtest performance without ref- 
erence to any particular patterns of achieve- 
ment. Weighted scores of all eleven subt: 
on the W-B were averaged for each case, 
the differences of all subtests from the mean 
Were summed disregarding sign. The sum ob- 
tained was the individual’s scatter score. An 
earlier pilot investigation showed that when 
all patients in the sample who had a scatter 


ests 
and 


score of 19 or greater were labeled schizo- 
phrenic and all below 19 were labeled neu- 
rotic or character disorder, we were correct in 
approximately 70% of the cases against the 
criterion of psychiatric diagnosis. Accordingly, 
in the present study a sequential analysis 
plan was set up (1) in which the hypothesis 
of 60% correct diagnoses (H,:P, = .60) was 
tested against the alternate hypothesis of 70% 
correct diagnoses (H,:P; = .70). Risks a and 
B were both set at .05. As each case was 
drawn, the diagnostic decision was based upon 
the following rules: 


Scatter index = 19 = schizophrenia. 
Scatter index < 19 = neurosis or character 
disorder. 


Each diagnosis made on the basis of the scat- 
ter index was matched against psychiatric 
diagnosis and plotted as correct or incorrect 
in the sequential analysis channel. 


Results and Discussion 


When the 269th case was plotted, the se- 
quential analysis plan yielded the decision to 
reject the hypothesis of 60% correct diag- 
noses in favor of the hypothesis of 70% cor- 
rect diagnoses (a = .05, 8 = .05). 

Computation of mean age at the time of 
testing shows the mean age in years to be 
31.8 for the schizophrenics, and 32.9 for the 
neurotics and character disorders. Mean IQ 
is 103.4 for the schizophrenics and 111.0 for 
the neurotics and character disorders. 

Since the patients used in this study consti- 
tuted a random sample of schizophrenics, 
neurotics, and character disorders who were 
referred for psychological testing, the diag- 
nostic composition of the total sample may 
be considered to approximate the actual base 
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Table 1 
Scatter Index Cutting Scores and Associated Diagnostic Consequences 
Schizophrenics Neur. and Charac. Disorders 
Scatter Cumula- Cumula- 
Index tive tive 
Cutting Fre- Fre- Fre- Fre- 
Score quency quency pb quency quency p: Ppi Qp: Hr Ae Re 
> 28 20 20 1205 1 1 .0097 7.4 4 45.3 94.9 7.8 
27 6 26 -1566 1 2 0194 9.6 a 47.2 93.2 10.3 
26 10 36 2169 3 5 0485 13.4 1.9 49.8 87.6 15.3 
25 8 44 2651 3 8 .0777 16.4 3.0 $1.7 84.5 19.4 
24 14 58 3494 3 11 -1068 21.6 4.1 55.8 84.0 25.7 
23 11 69 .4157 5 16 1553 25.6 5.9 58.0 81.3 31.5 
22 10 79 4759 3 19 «1845 29.4 7.1 60.6 80.5 36.5 
21 11 90 , 5422 3 22 -2136 33.4 8.2 63.5 80.3 41.6 
20 16 106 6386 7 29 2816 30.4 10.8 66.9 78.5 50.2 
19 9 115 6928 9 38 -3689 42.7 14.1 66.9 75.2 56.8 
18 8 123 .7410 4 42 A078 45.7 15.6 68.4 74.6 61.3 
17 13 136 8193 6 48 -4660 50.6 17.8 71.1 14.0 68.4 
16 7 143 .8614 4 52 5048 53.1 19.3 72.1 73.3 72.4 
15 4 147 "3855 12 64 “6214 54.6 23.8 69.1 69.6 78.4 
14 3 150 -9036 11 75 -7282 55.8 27.9 66.2 66.7 83.7 
13 4 154 9277 15 90 8733 57.2 33.5 62.0 63.1 90.7 
12 7 161 19699 7 97 9417 59.8 36.1 62.0 62.4 95.9 
11 2 163 9819 3 100 .9709 60.6 37.2 61.7 62,0 97.8 
<10 3 166 1.0000 3 103 1.0000 61.7 38.3 61.7 61.7 100.0 


Note.—Base rate for schizophrenics (P) = 61.7%. Base rate for neurotics and character disorders (0) = 38.3%. 


rates of such patients at our hospital. We 
found that schizophrenics composed 61.7% 
of our sample, while neurotics and character 
disorders composed 38.3%. This breakdown 
of course, is based upon a hospital subpopula- 
tion from which other diagnostic classifica- 
tions such as brain damage, psychotic depres- 
Sion, etc. are excluded. 

It has been shown that with the method of 
computing scatter used in this study, and 
with the adoption of a scatter index of ‘19 as 
a cutting score, schizophrenics could be dif- 
ferentiated from neurotics and character dis- 
orders in more than 60% of the cases, In 
terms of the sequential analysis model ‘0 = 
erating at a level of 70% correct diagnoses ‘s 
significantly more likely than Operating at a 
level of 60% correct diagnoses, But havin 
established this, we are still concerned with : 
number of other questions about the diag- 
nostic decisions that might be made on hs 
basis of the W-B scatter index. Table 1 pre- 
sents an analysis of diagnostic consequences 
in the sample of patients for a number of 
different scatter index cutting scores. It is 
based upon procedures outlined by Meehl 
and Rosen (3). Following are definitions of 
terms used in the table: 


pı = Proportion of schizophrenics correctly . identi- 
fied by the test (“valid positive” rate). 
pa = Proportion of neurotics and character disor- 
ders misidentified by the test as schizophrenic 
(“false positive” rate). 
Pp, = Percentage of total sample correctly identified 
as schizophrenic. 
Qp, = Percentage of total sample misidentified as 
~ schizophrenic. 
r = Percentage of total correct diagnoses. 7 
Hp = Percentage of correct diagnoses if a diagnosis 
is made only for patients scoring at or above 
cutting score. 
Rp = Percentage of patients in total sample who 
receive a diagnosis if a diagnosis is made only 
for patients scoring at or above cutting score. 


If nothing but base rates were available to 
us for making a diagnostic decision, we woul 
call all patients schizophrenic and we woul 
be correct in 61.7% of the cases. In this te 
gard, one might ponder how much an informal 
appreciation of patient base rates might be 
contributing to our diagnostic acumen. 

It can be seen from Table 1 that when our 
original cutting score of 19 is used, we ate 
correct in 66.9% of the cases (Hr). We have 
thus shown an improvement of 5.2% Ove" 
base rate diagnosis. However, when we us a 
cutting score of 16, our percentage of total 
correct diagnoses rises to 72.1%, an improve- 
ment of 10.4% over base rate diagnosis. 


| 


W 


Wechsler-Bellevue Scatter and Schizophrenia 


we choose to make a diagnostic statement only 
for those patients identiñed as schizophrenic 
by our index, it can be seen that with a cut- 
ting score of 19 we make 75.2% correct diag- 
noses (Hp). In this case, however, we are 
able to offer a diagnosis for only 56.8% of 
the patients in our total sample (Rp). Within 
the limits of our procedure, as we increase our 
accuracy in making positive diagnoses, we pay 
the penalty of reducing the percentage of pa- 
tients about whom we can make diagnostic 
statements, Numerous other contingencies 
may be observed from Table 1. The reli- 
ability and generality of our “valid positive” 
and “false positive” rates can only be deter- 
mined by cross-validation in a variety of 
clinical settings. Their associated diagnostic 
contingencies will vary as actual clinical base 
rates P and Q change. 


Summary 


A Wechsler-Bellevue scatter index based 
upon the sum of subtest deviations from the 
mean subtest score was computed for a sam- 
ple of schizophrenics, neurotics, and charac- 
ter disorders. A cutting score of 19 was used 
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as a basis for discriminating schizophrenics 
from neurotics and character disorders. The 
accuracy of discrimination was judged against 
the criterion of psychiatric diagnosis. The hy- 
pothesis of 60% correct diagnoses was re- 
jected in favor of the alternate hypothesis of 
70% correct diagnoses in a sequential analy- 
sis test. Data were presented showing other 
diagnostic consequences in our sample of pa- 
tients arising from the application of various 
scatter index cutting scores. 


Received April 25, 1957. 
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Validity of the Hewson Ratios: Investigation of a 
Fundamental Methodological Consideration”? 


Walter F. McKeever and Alvin I. Gerstein 


University of Rochester 


Hewson (2) has described a method for 
diagnosing brain pathology from ratios com- 
puted between Wechsler-Bellevue I weighted 
subtest scores. The effects of age and IQ 
variables on these ratios have never been as- 
sessed, and little validation data are available 
on the method. The present study aims to 
help fill these gaps. 


diagnosed differently. The total groups were 
matched on age and IQ. These groups were 
also divided into those with IQs above and 


groups. There 
etween groups 
‘oss diagnostic 


Over-all accuracy of Hewson diagnoses was 
54.9%, or essentially chance, Although the 
100+ groups were significantly differentiated in 
the correct direction, fully a third of the 100+ 
schizophrenics were misclassified as organics, 
In the 99— groups, actual organics were cor- 
rectly identified no better than chance, while 


1 An extended report of this study may be ob- 
tained without charge from Walter F. McKeever. 
Department of Psychology, University of Rochester, 
Rochester, N. Y., or for a fee from the American 
Documentation Institute. Order Document No; ——= 
remitting $—— for microfilm or $—— for photo 
copies. 

2 The aid of B. F. McNeal and the staff of Canan- 
daigua VA Hospital, Canandaigua, N. Y., is grate- 
fully acknowledged. The study was done during the 
writers’ internships at Canandaigua. 


75% of the schizophrenics were misclassified 
as organics, a finding approaching signifi- 
cance (p = .10). Patients who performed or- 
ganically were significantly older and less in- 
telligent as a group than were those who did 
not (p= .01). Point biserial correlations be- 
tween organic performance and age and IQ, 
respectively, were .45 and — .34, both signifi- 
cant beyond the 1% level. The r between age 
and IQ was .09, nonsignificant. 

These results are generally inconsistent 
with the more positive ones reported by 
Gutman (1). Inspection of Gutman’s data 
suggests the possibility that her organics may 
have been significantly older and less intelli- 
gent than the controls, a situation favoring 
artifactually positive results. 

The following conclusions seem justified: 

1. Organic performance on the Hewson 
ratios varies systematically with age and IQ 
variables. Nearly a third of the variance of 
organic performance is associated with vari- 
ance in age and IQ. 

2. The method does not differentiate the 
groups studied beyond a chance level; among 
patients with IQs below 100 it makes at least 
as many errors as it does correct diagnoses- 

3. The need for control of logically rele- 
vant variables seems re-emphasized by the 
findings. 

Brief Report. 
Received December 2, 1957. 
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Brain Injury and Intellectual Performance 


Alan O. Ross* 
Clifford Beers Guidance Clinic, New Haven, Conn. 


The question whether intelligence deterio- 
rates after brain injury has been investigated 
in a number of studies whose results are con- 
tradictory (4). In connection with an investi- 
gation dealing with the effect of brain injury 
on tactual perception, this writer (3) gathered 
data relevant to intelligence test performance 
which, though not conclusive, indicate that 
brain injury may have a deleterious effect on 
the ability measured by such tests. i 

Subjects (Ss) were 20 soldier patients with 
a mean age of 22.8 years who had undergone 
brain surgery within 12 months before the 
date of the study. Only those cases were in- 
cluded where surgery had involved at least an 
incision of the dura. Except for one tumor an 
two accident cases, all traumata had been due 
to gunshot or shellfragment injuries located in 
the frontal, temporal, or parietal regions. For 
each S, the score he had made on the Army 
General Classification Test (5), taken some 
time before he sustained his injury, was ob- 
tained from the soldier’s records, furnishing 
a measure of his premorbid intelligence- At 
the time of the study, each S was given the 
CVS Individual Intelligence Scale (1) which 
provided a measure of his postinjury func- 
tioning. The CVS consists of the comprehen- 
sion and similarities items of the Wechsler- 
Bellevue and a vocabulary scale based on the 
Stanford-Binet word list. The CVS correlates 
with a classification test simliar to the AGCT 
on the order of .80 (1), and in an analysis 
conducted by this writer, using 37 normal Ss, 
the AGCT and CVS were found to have an r 
of .75 (£ = 6.61, p < .001). 

By i ated the AGCT and CVS scores 


er was a Ist 


1 i i writ 
At the time of this study the Reed Army 


Lt., MSC, US Army, stationed at Walter 
Hospital. 


into deciles, it is possible to test for the sig- 
nificance of the difference between the pa- 
tients’ preinjury and postinjury scores, using 
the formula for correlated means presented by 
McNemar (2). The postinjury scores are sig- 
nificantly lower than the preinjury scores with 
a t of 3.50 (p < .01). This relationship can 
also be demonstrated by a matched group 
technique where the more highly discriminat- 
ing CVS standard scores and original AGCT 
scores can be utilized, thus eliminating the 
transformation into deciles. Each patient was 
matched individually with a normal, drawn 
from the service personnel of a major army 
hospital, controlling for AGCT score, age, and 
years of education. Each of the normals was 
given the CVS as part of the study. Table 1 
shows the result of the AGCT matching and 
the comparison of CVS scores for patients 
and normals. When patients are matched with 
normals on the basis of the patients’ preinjury 
scores, the patients have significantly lower 
scores when tested within 12 months after 
brain surgery. 

A converse comparison is possible by match- 
ing the patients with different normals using 
the criterion of patients’ postinjury (CVS) 
scores, again holding age and years of educa- 
tion constant. An analysis of the differences 
in AGCT scores for the matched pairs shows 
that the patients’ (preinjury) scores are sig- 
nificantly higher with a ¢ of 3.23 (p < .01). 

These results, though statistically signifi- 
cant, provide only presumptive indication that 
intelligence test performance deteriorates as 
the result of certain forms of brain injury. A 
more direct test of this question would have 
been to readminister the AGCT to all patients 
postoperatively, but this was unfortunately 
not possible due to the procedure dictated by 
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Table 1 


Intelligence Test Scores of Patients and Normals 
(N = 20 pairs) 


Mean t for 
z oo Se Mean 
Set RGumaG Parents Difference p 
AGCT 59.0 59.6 62 >50 
cvs 314 284 250 <05 


the primary study (3) to which these findings 
are incidental. 
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The Clinical Usefulness of the Archimedes Spiral 
in the Diagnosis of Organic Brain Damage”? 


Lewis R. Goldberg 


University of Michigan 


and Philip A. Smith 
Ann Arbor VA Hospital 


In reporting their promising results using 
the spiral aftereffect to differentiate groups of 
patients with cortical involvement from non- 
organic control groups, Price and Deabler 
concluded that “. . . the results are such as 
to justify present clinical use of this tech- 
nique in diagnosis of organicity” (4, P- 302). 
They found almost no overlap in the per- 
formance of their groups: fewer than 8% 
of normals or functional psychiatric patients 
were misclassified as organic and only 2% of 
their organic group was incorrectly classified. 
While they reported no data on such vati 
ables as age, which might have contributed 
to their results, the description of the syn- 
dromes included in the organic group suggest 
that this group was considerably older than 
the normals or psychiatric patients. However, 
later studies by Gallese (2) and Page et al. 
(3) showed no significant age-score relation- 
ship, and offered some additional evidence 
for Price and Deabler’s original assumption. 
Gallese, however, noted that the spiral test 
was relatively insensitive with certain types 
of organic patients, notably those with con- 
vulsive disorders or brain syndromes associ- 
ated with alcoholism. The performance of 
twelve lobotomized schizophrenics also was 


1The authors wish to thank E. Lowell Kelly at 
the University of Michigan for his critical reading © 
this manuscript, and express gratitude tothe SA 
chiatric Research Committee of the Ann Arbor Me 
Hospital for encouragement and assistance in this 
Study. 

2 The statements and conclusions of the authors do 
Not necessarily reflect the opinions oF policy of the 
Veterans Administration. 


indistinguishable from that of nonlobotomized 
schizophrenics and normals. Page et al. sup- 
ported Price and Deabler’s theoretical as- 
sumptions but their study provided “... 
less evidence that the aftereffect may serve 
as an effective diagnostic device” (4, p. 91). 
These investigators also noted unimpaired 
performance on the part of some lobotomized 
schizophrenics. They did not report separate 
data for patients with convulsive disorders. 
A study by Standlee (5) of psychiatric pa- 
tients tested before and after electric shock 
treatment (which generally produces some 
temporary organic dysfunction) was incon- 
clusive because the effect of prior experience 
with the spiral was not controlled. 

During the course of their clinical practice 
at the Veterans Administration Hospital, Ann 
Arbor, Michigan, the present writers utilized 
the Archimedes spiral as a part of their test 
battery in examining patients referred for 
psychological evaluation. The present paper 
reports on findings over a period of one year. 


Method 


Apparatus. The instrument used in this 
study was a 78 rpm phonograph turntable, 
vertically mounted on an 8 X 14 inch black 
box which housed the motor. One clockwise 
and one counterclockwise Archimedes (or 
Plateau) spirals, each 24 circuits (920 de- 
grees) about the center, were painted in 
plack on 10-inch white cardboard discs, 
which could be affixed to the turntable. This 
instrument differed slightly from that of 
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Table 1 
Diagnostic Classification of Subjects 


Subject group Diagnosis N 
Normal No pathology 30 
Psychiatric Schizophrenia 4 

Psychoneurosis 8 

Psychophysiologic reaction 5 
Post-EST Schizophrenia 10 

Psychoneurosis 1 
Organic Cerebral thrombosis 


Arteriosclerosis 
Convulsive disorder 
Cerebral neoplasm 
Encephalomyelitis 
CNS lues 

Paralysis agitans 


Rem wuUuWAD 


Previous investigators both in speed of rota- 
tion and diameter of the spiral. Others (1, 2, 
3, 4) have reported using spirals varying 
from 3} inches to 8 inches in diameter and 
at speeds varying from 78 to 100 rpm. 

Procedure. The following procedure was 
standard for all subjects (Ss): S was seated 
approximately 8 feet from the instrument in 
an office with good illumination. The spirals 
were presented in ABBA order, with the in- 
terval between successive trials varying with 
the duration of reported after-image. Each 
oe was for 30-seconds’ duration. Instruc- 

given to Ss Were essentially the same as 
those used by Price and Deabler: “This is a 
special eye test. Look at the center (point- 
ing) and don’t take your eyes away until I 
tell you to.” Approximately ten seconds after 
rotation was begun, S was asked, “What does 
the line appear to be doing?” After the spiral 
had been braked to a stop, the last instruc- 
tion was repeated and S’s response was re- 
corded. 

Subjects. The population from which Ss 
were selected included both staff and patients 
from the psychiatric and neurological wards 
of the Ann Arbor VA Hospital (Table 1). 
Patients classified as organics were those 
with mild to grossly limiting cortical dysfunc- 
tion, confirmed by independent neurological 
diagnosis. Patients with questionable or mar- 


ginal organic dysfunction were not included 
in the present analysis, except for a group of 
eleven psychiatric patients who were seen 
one to seven days following a course of four 
or more electro-shock treatments (EST). 
These were presumed to show a possible 
temporary organic deficit due to the effects 
of EST. The remaining psychiatric patients 
were untreated by EST and were seen dur- 
ing the acute fulminating stage of their ill- 
ness, shortly after admission to the hospital. 
The normal control group included ward phy- 
sicians, psychiatrists, psychologists, nurses, 
secretaries, and students employed at the 
hospital. 

Scoring. Responses from all Ss were re- 
corded verbatim and scored according to the 
criteria of Price and Deabler and also those 
proposed by Gallese. The latter method, 
which gave equal credit for a description of 
the aftereffect either as a change in apparent 
size or direction of movement, was judged the 
most applicable for the present analysis, 
since a large proportion of responses was 
phrased as some combination of these terms. 
Working independently from a sample of 38 
verbatim protocols, the authors agreed per- 
fectly in this manner of scoring for 35 Ss. 
Since four partial scores contributed to the 
total score for each S, this represented a 
total of 152 sets of independent judgments 
for which the scorers agreed 146 times 


(96%). 
Results 


Table 2 summarizes the findings for all 
groups. The normal Ss were superior to all 
others, attaining, without exception, perfect 
scores. Because of the absence of within- 


Table 2 
Spiral Aftereffect Scores 


Mean score 
Mean Mean adjusted 
Subject group age score for age 
Normal 29.3 4.00 it 
Psychiatric 35.7 2.94 2.72 
Post-EST 38.5 2.55 2.45 
Organic 45.0 2.17 2.37 
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Table 3 


Distribution of Aftereffect Scores 
(after Price and Deabler) 


Score 
Subject group 0 1 2 3 4 
Normal 0% 0% 0% 0% 100% 


z sychiatric 11% 6% 18% 6% 59% 
Post EST 18% 0% 27% 18% 37% 
Fennie 33% 4% 13% 13% 37% 


group variability for the normal Ss, usual 
Parametric tests of significance were inap- 
propriate Accordingly, a chi-square value 
as obtained for the difference between nor- 
oe and the combined patient groups. When 
wus was found to be significantly large (x? 
ek ge p < .001), the normals were ex- 
an, on from subsequent statistical tests. An 
zm ysis of covariance for spiral scores of the 
eet groups, adjusted for age, Was not 
a anally significant (F < 1). Examina- 
a of the adjusted mean scores, presented 
ie able 2, shows that the organics neverthe- 
t ss maintained the low order position among 
e groups. 
ne Pearson product-mome 
a Ween age and spiral score was ¢ 
patients for whom IQ measures were avail- 
able, the correlation between intelligence an 
Spiral score was small and not significant (r 
Because these findings seemed so incom- 
patible with the results of previous studies, 
ae data were arranged according to the pro- 
he ures followed by earlier investigators m 
P „comparisons made. Table 3 shows 
istribution of scores following Price an 
os original presentation. The patients 
ere then split into those whose scores were 
or under and those whose scores exceede 


» after Gallese. Table 4 summarizes this 
ee sis and shows the percentage of patients 
vho were correctly classified as “organic” OF 
normal” by this method. Table 4 also shows 
aa. results of this breakdown for gh 
Pome as convulsive disorder °" other 
Ypes” of organic dysfunction. he present 
Bures contrast sharply with those reported 


Y Price and Deabler and Gallese- 


nt correlation 
— 39. For 


Discussion 


These findings cast considerable doubt as 
to the utility of the spiral aftereffect for dif- 
ferential diagnosis of organicity. Although 
Price and Deabler’s results appeared so 
promising, later work (2, 3) made their find- 
ings look more conditional. The present find- 
ings add an even more compelling note of 
caution to the use of the instrument as a 
method of diagnosis. This seems especially 
important since all the published studies used 
clear-cut cases of cortical dysfunction, while 
in clinical practice, neurological involvement 
is often marginal or partial and thus the 
diagnostic problem might be expected to be 
even more difficult. 

The organics used in the present study 
were all drawn from a group of recent ad- 
missions to a general medical and surgical 
hospital, and one might hypothesize that such 
patients tend more likely to show acute rather 
than chronic deteriorative effects of cortical 
destruction. Patients exhibiting chronic symp- 
toms are more typically found in the VA 
neuropsychiatric hospitals and state institu- 
tions where the earlier studies were con- 
ducted. This might be one reason why the 
present data differs from previous findings. 
For the same reason, however, the present 
psychiatric groups did not include chronic, 
deteriorated schizophrenics, and it is difficult 
to understand how so large a proportion of 
these relatively intact patients failed to at- 
tain perfect scores. Our instructions and scor- 
ing procedures were identical to those of ear- 
lier investigations although some differences 
may have arisen from the manner in which 


Table 4 


Classification of Subjects According to 
Gallese Criteria 


Organic Normal 
score score Correctly 
Subject group (2 or under) (3 or over) classified 
Normal 0 30 100% 
Psychiatric 6 11 65% 
Post-EST 5 6 = 
Organic 12 12 50% 
Convulsive s 
disorder 2 3 40% 
Other types 10 9 53% 
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inquiries were conducted. Gallese noted that 
many schizophrenics would have been scored 
“organic” had not a detailed, direct inquiry 
been performed, and Page et al. reported a 
need for an objective nonverbal response 
measure for use with the spiral. Perhaps a 
multiple choice response situation such as 
that offered by Freeman and Josey (1) would 
insure more uniform results. 

Many patients, both organic and psychi- 
atric, suffered from disturbances in their 
ability to communicate effectively. Thus, al- 
though the spiral as originally presented ap- 
peared to be a neat, objective evaluative tech- 
nique, in actual practice a large degree of 
clinical acumen may be necessary to deter- 
mine an S’s exact perception. The less con- 
tact the patient has with reality (whether 
functional or organic in origin) the less is 
the likelihood that correct inferences regard- 
ing his perception can be made. Caution must 
be observed in interpreting the remarks of 
negativistic patients, as well as overly defen- 
sive persons who wish to deny any experi- 
ence which they perceive as a malfunction. 
Some patients expressed fear that reporting 
the aftereffect was tantamount to admitting 
a delusion, and one was concerned lest he be 
hypnotized unknowingly. Other patients, de- 
spite repeated instructions, responded to the 
spiral as a kind of projective technique, re- 
porting such phenomena as “it looks like a 
pois snake, ready to strike,” and “it is a 
ram’s horn, all curled up.” The present au- 
thors do not imply that these cautions are in 
any way unique to the spiral technique but, 
rather, that this test shares with many other 
diagnostic instruments the difficulties en- 
countered in evaluating verbal report. 

It would appear also that variables such as 
the rate of rotation and size of the spiral, 
level of illumination, and other test condi- 
tions might well have some influence on re- 
sults. For example, it was noted in prelimi- 
nary work that the perception of movement 
toward or away from S was in part a func- 
tion of the distance between the exact center 
of the turntable and the placement of the 
spiral upon it. When the spiral was posi- 
tioned so that it turned about its exact cen- 
ter, then much less perception of changing 
distance occurred. Whether such variables 
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have a differential effect on different popu- 
lations is unknown. 

The one variable in this study which did 
seem related to ability to perceive the effect 
was age. Moreover, Freeman and Josey found 
marked differences in ability to see the after- 
effect in a population of psychotic patients, 
and although they related this deficiency to 
memory impairment, their data would indi- 
cate that age may have been a factor. In 
both the Price and Deabler and Gallese stud- 
ies, the organic groups appeared substantially 
older than their nonorganic controls. 

There is a discrepancy between the present 
results and those of Standlee in regard to 
post-EST patients. Standlee reported that 23 
out of 25 patients perceived the aftereffect 
on a retest 8 hours after one EST. In the 
present post-EST groups, scores ranged from 
0 to 4 and were little correlated with clinical 
impression of “organicity.” As has been sug- 
gested elsewhere (4), practice effects may 
have contaminated Standlee’s results; more- 
over, the discrepancy between the two studies 
was probably even more heightened by the 
fact that all Standlee’s Ss had considerably 
fewer shock treatments than the present ones. 
On the other hand, in the present study there 
was no apparent correlation between after- 
effect score and number of EST or length of 
time since the last treatment. 

One of the paramount problems in all stud- 
ies utilizing the spiral has been the difficulty 
in establishing a satisfactory set of criteria of 
organic brain damage. In most studies, an 1M- 
plicit assumption is made that localization, 
chronicity, and degree of neurological de- 
struction are irrelevant variables, as well as 
such factors as the optical efficiency of the 
S and the pharmacological effect of the drugs 
he has been administered. The fact that suc 
a viewpoint is basically unsound has alreacy 
been suggested (6). To date most studies, 17 
cluding the present one, confound these cru- 
cial variables and thus they cannot be effec- 
tively compared. 


Summary 


This study is an evaluation of the Arpit 
medes spiral as a clinical technique for te 
diagnosis of organic brain damage. Over & P& 


=y 


The Archimedes Spiral in Diagnosis 


riod of a year’s work with the instrument the 
authors noted that normal Ss report perceiv- 
ing the aftereffect of both expanding and 
Contracting spirals without a single instance 
of failure. Psychiatric, post-EST, and organic 
Patients—in respective order—performed with 
decreasing efficiency on the same task. When 
the scores for the groups were adjusted for 
age, however, the differences between the 
latter three groups became statistically indis- 
tinguishable. The correlation between age and 
Spiral score was — .39. 

In spite of early enthusiasm for the spiral, 
the present results warn against its indis- 
criminate use for differential diagnosis. 
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. Identification of Item Factor Patterns 
Within the Manifest Anxiety Scale’ 


A. W. Bendig 


University of Pittsburgh 


O’Connor, Lorr, and Stafford (2) have re- 
ported a factor analytic study of the item con- 
tent of Taylor’s Manifest Anxiety Scale. Tet- 
rachoric correlations were computed among 
42 MAS items (omitting eight items with 
marginal frequencies of less than 10 per cent) 
for a sample of 220 undergraduate Ss. Five 
oblique factors were extracted and described 
in terms of the apparent content of items 
highly loaded for each factor. No external 
validation of the factors was attempted. 

It has been shown (1) that MAS scores 
correlate highly (7 = -76) with scores from 
5 ee a scale contained in 

ysenck’s Maudsley Personalit Invento 
(MPI) and are less highly ta (r= z 
-34) to the MPI Extraversion (E) scale. This 
suggests that some of the MAS factor pat- 
terns found by O’Connor, Lorr, and Stafford 
may be identified as “extraversion” or “ 


Toticism” factors within the multidimensj, 
n 
rie 1 sional 


li of the factors 
might be a “sex” factor. 


Both the MAS and MPI inventories were 
administered to 145 Ss (100 men and 45 
women) enrolled in introductory psychology. 
Each of the 42 MAS items was correlated 
(biserial-phi) with the sex criterion and these 
coefficients were correlated (product-moment) 
with the item factor loadings reported by 
O'Connor, Lorr, and Stafford. None of these 
five correlations (one for each factor) were 
significant. 

The Ss were dichotomized at the medians 

1 An extended report of this study may be ob- 
tained without charge from A. W. Bendig, Dept. of 
Psychology, University of Pittsburgh, Pittsburgh 43, 
Pa., or for a fee from the American Documenta’ i 
Institute. Order Document No. 5466, remitting $1.25 
for microfilm or $1.25 for photocopies. 


of the distributions of their E and N scores 
and each of the 42 MAS items was corre- 
lated (tetrachoric) with total scores on these 
two MPI scales. The E criterion item validi- 
ties were then correlated with each of the five 
sets of item factor loadings and a similar 
procedure was followed with the N criterion 
item validities. The item validities for the E 
scale criterion were significantly related (.01 
level) to the factor loadings on Factor D (r 
= — .51), but were not significantly corre- 
lated with the other four factors (r = .06, .01, 
-05, and — .04). The N scale item validities 
were significantly correlated with factor load- 
ings on Factors A, B, and D (r = .38, — .49, 
and .35), but were not related to Factors C 
and E (r= .23 and .25). The E and N cor- 
relations with Factor A (r= .06 and .38) 
were significantly different at the .01 level 


(F = 7.94) as were the E and N correlations _ 


with Factor B (r=.01 and —.49, F= 
11.12). The E and N correlations with Factor 
D (r= — .51 and .35) were not significantly 
different (F = 1.06) because of the negative 
correlation (r = — .42) between the E and N 
criteria validities of the 42 MAS items. 
Factors A and B found by O’Connor, Lorr, 
and Stafford (2) appear to be similar to the 
“neuroticism” factor identified by Eysenck, 
while Factor D seems to be a combination oi 
Eysenck’s “neuroticism” and “introversion 
factors. 
Brief Report. 
Received November 12, 1957, 
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Intelligence in Childhood Schizophrenics, Other Emo: 
tionally Disturbed Children, and Their Mothers 


Anthony Davids 


Brown University and Emma Pendleton Bradley Hospital 


Much of the research devoted to assessment 
of intellectual functioning in children and 
adults has been generated by the nature- 
nurture or heredity-environment controversy 
(1). In this regard, several previous studies 
ave been concerned with intellectual simi- 
larities between (a) normal children and their 
Parents, (b) normal siblings, (¢) identical 
twins and fraternal twins, and (d) foster 
children and their foster parents. The effects 
on children’s IQ of impoverished home envi- 
ronments and of institutionalization have been 
Studied. And the effects of enriched environ- 
ments and special schooling have also been 
related to intellectual functioning in children. 
® excellent surveys of these numerous 
les, with exhaustive bibliographies, are 
ailable elsewhere (1, 5, 11), they will not 
be given detailed consideration in this report. 

In spite of the wealth of previous investi- 
8ation in this topical area, there is still very 
little empirical evidence bearing on the prob- 
lem of relations between intellectual function- 
Mg in severely disturbed children and in their 
Mothers, In the attempt to gain further un- 
derstanding in this regard, the present study 
Seeks answers to the following four que 


; 
| a stions. 
| Is there a significant correlation between 


the 
obtained by children who are severely 
isturbed emotionally and the IQs obtained 
Y their mothers? Is there a significant dif- 
e mothers and 


dren? Is there 
IQs of 


TR between the IQs of th 

Daa e IQs of their disturbed chil 
significant difference between the 

others of schizophrenic children and the IQs 

Of mothers of children suffering from other 

ee of emotional disturbance? Is there 3 

74 Snificant difference between the IQs ° 
Chizophrenic children and the IQs of other 


types of emotionally disturbed children? The 
findings obtained in answer to these questions 
should be of interest both to investigators 
who are concerned with theoretical aspects of 
the problem of psychopathology and intel- 
lectual functioning, and to clinicians who are 
faced with the practical problem of building 
programs for assessing children and parents 
in the many new child treatment centers that 
are being established. 


Method 


The findings to be presented in this report 
are the result of a five-year program of psy- 
chological assessment of hospitalized emotion- 
ally disturbed children and their mothers.? 
The patients were 70 boys and girls, between 
the ages of 5 and 12, who were undergoing 
residential psychiatric treatment at the Emma 
Pendleton Bradley Home. Of this sample, 12 
children were diagnosed as schizophrenic, and 
58 were diagnosed as either severe behavior 
disorder or neurotic. Also serving as subjects 
in this study were the mothers of the children. 
These 70 women, between the ages of 26 and 
46, were all living in the community. At the 
time of the child’s admission to the institu- 
the mother was examined with a com- 


tion, k 
attery of psychological tests, in- 


prehensive b 


1 The assessment program was initiated by M. W. 
Laufer, E. Z. Rubin, and S. Koret. The author wishes 
to gratefully acknowledge the many hours of testing 
conducted by Rubin, M. Talmadge, Pearl Gore, and 
several psychology interns who have served at the 
Bradley Home. The conception of the present study, 
experimental design, statistical analyses of data, and 
this report are the contributions of the present au- 

The writing of this report was facilitated by 
k; rch Grants M-1722 and M-2087 from the Na- 
tional Institute of Mental Health, United States Pub- 


lic Health Service. 
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cluding the Wechsler Bellevue Intelligence 
Scale (short form), Rorschach test, TAT, and 
figure drawings. The children were also ex- 
amined by experienced clinical psychologists 
who included the complete Wechsler Intelli- 
gence Scale for Children, along with projec- 
tive tests and visual-motor tests, in their bat- 
tery of techniques. The present report is con- 
cerned solely with the results of intelligence 
testing; the results of the mother-and-child 
personality assessment must await further 
work. Thus, the data for this study consist of 
the mothers’ IQs based on their performance 
on the comprehension, vocabulary, picture 
completion, and block design subtests of the 
adult W-B, and the children’s IQs based on 


their responses to the 10 subtests of the 
WISC. 


Results and Discussion 


The results show that there is a significant 
Positive correlation (7 = .34, p=.01) be- 
tween the IQs of the 58 nonschizophrenic dis- 
turbed children and their mothers. In the 
schizophrenic group, however, there is no as- 
sociation (7 = .02) between the indices of in- 
telligence in the mothers and children. It 
should be pointed out that this correlation is 
based on the scores of only 8 schizophrenic 
children, as 4 of the group of 12 schizophren- 
ics were untestable. They would neither at- 
tend to the test material nor attempt to cope 
with it, and in these cases only fragmentary, 


Table 1 
Comparison of IQs of Mothers and of Their Emotionally Disturbed Children 


if any, test data were obtained, making any 
estimate of IQ practically impossible and even “* 
more unreliable than the estimates for the 
other schizophrenic children. 

The coefficient obtained with the other 
types of disturbed children and their parents 
is lower than the coefficients in the vicinity 
of + .50 that have been reported (2, 3, 7, 8, 
10) in studies of normal children and their 
parents, but even this degree of association is 
quite striking in view of the host of factors 
that would militate against finding a signifi- 
cant relation in our study. To mention only a 
few of these sources of error—the mothers’ . 


under conditions of stress (time of admission 
of child to hospital), and it is a well-known 
fact that emotionally disturbed children rarely 
are able to function at their optimal level on 
intelligence tests. Thus, in spite of these nega- 
tive factors, a significant correlation was ob- 
tained, and one can only wonder what mag- 
nitude of relation might be found if these esti- 
mates of intelligence were not influenced by 
the intrusion of severe psychopathology. 
Turning now to the differences between the 
performances of the mothers and children, 
presented in Table 1, a striking difference of 
38 IQ points is found between the schizo- 
phrenics and their mothers, and a difference 
of 15 IQ points between the other disturbed 
children and their mothers. In both compari- 


$ 


Group 


N Mean Variance 


v 


Mothers of nonschizophrenics 
Mothers of schizophrenics 
Nonschizophrenic disturbed children 
Schizophrenic children 
Groups compared 

Mothers of nonschizophrenics 

vs. mothers of schizophrenics 
Mothers of nonschizophrenics 

vs. their children 
Mothers of schizophrenics 

vs. their children 
Nonschizophrenic disturbed children 

vs. schizophrenic children 


58 108.1 175.8 
12 122.1 88.1 
58 92.7 177.1 

8 84.0 302.6 


t F 
3.86** 2.00 


v 


6.70** 1.01 


5.68** 3.44* 


| 
IQs were based on a shortened form of the j 
intelligence test, the mothers were examined 
| 
| 


* Significant at .05 level. 
** Significant at .001 level. 


1.65* 1.71 j 


Intelligence of Disturbed Children and Their Mothers 


sons, these differences are significant well be- 
yond the .001 level. Thus, it is evident that 
in the intellectual sphere the mothers fare 
much better than do their suffering offspring. 
lt is clear that the burden of emotional con- 
flict exacts a heavy intellectual toll in the 
young. 

The two groups of mothers were compared. 
Even though the mean IQ of 108 obtained by 
the mothers of nonschizophrenic children is 
above the average for the general population, 
the mean IQ of 122 for the mothers of the 
schizophrenic children is significantly higher. 
This empirical finding is in keeping with clini- 
Cal observations reported by several special- 
ists in the field of childhood schizophrenia. 
Kanner, in describing the “indisputably high 
level of intelligence” of parents of cases of 
infantile autism, reports that “All but 5 of 
the mothers of the 55 children have attended 
College. All but one have been active voca- 
tionally before, and some also after, marriage 
as scientists, laboratory technicians, nurses, 
Physicians, librarians, or artists. - - - My 
Search for autistic children of unsophisti- 
Cated parents has remained unsuccessful to 
late. . . . Most of the parents declare out- 
right that they are not comfortable in the 
Company of people; they prefer rea y 
mg, painting, making music, Or just ‘think- 
mg’ ” (6, pp. 420-421). Rank, who also de- 
Scribes the use of intellectualization and ob- 
Sessiveness in the parents of atypical children, 
Teports that “, . . not too rarely they are 

ighly intellectual, prominent people” (9, P: 

31). Despert also emphasizes that mothers 
of these psychotic children seek gratification 
es intellectual sources rather than irom 
i with people. According to her, ese 
Wo significant characteristics of the mother 
and child which are frequently encountered in 

© group are, namely, the emotional detach- 
Ment and the overintellectualization in the 
Mother and the early absorption of the child 
m nonhuman content and nonfunctional ac- 
tivities, such as extensive acquisition of knowl- 
edge of musical records, license Plate num- 

ers, astronomical data, large and aa 
briate vocabulary, word spelli On the 
One hand, the mother is remote an 

© other she puts excessive pressure 


ding, writ- 


ng, etc. 
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growing baby to achieve feats of development 
which are considerably beyond his age level 
and interests” (4, p. 346). 

The findings in the present research would, 
therefore, be predicted on the basis of these 
clinical reports. Discussion of similarities and 
differences between the present group of 
schizophrenics and those previously described 
as “autistic” or “atypical,” as well as detailed 
description of the personalities of the moth- 
ers, are beyond the scope of the present re- 
port. It is only emphasized that for the kind 
of child diagnosed as schizophrenic at the 
Bradley Home, and for the kind of mothers 
of children who are admitted to this institu- 
tion, the intelligence test findings fit well 
with previously reported observations. 

Finally, the comparison between the IQs of 
the schizophrenic children and their non- 
schizophrenic emotionally disturbed peers who 
were also undergoing residential treatment is 
of interest. The schizophrenics, with an aver- 
age IQ of only 84, score 8.7 IQ points be- 
low the other disturbed children. Since schizo- 
dren are even more disturbed than 
most instances emo- 
ts from intellectual 


phrenic chil 
the others, and since in 
tional disturbance detrac' 
functioning, this finding is in accord with the 
prediction of poorer performance by schizo- 
phrenics and, accordingly, is statistically sig- 


nificant. ; s 
In viewing these results of intelligence test- 


ing, it is noteworthy that the average IQ for 
this total sample is just about 92, which is 
considerably below the average for children 
in general. As mentioned above, some of the 
psychotic children are untestable, and as a 
group they perform very poorly. Even the 
ones who employ a mechanized, intellectual- 
ized approach to the world do not do very 
well on the standard tests because their spe- 
cialized knowledge, obsessive concern for cer- 
tain specific details, preoccupations with tech- 
nical gadgets, astronomy, and so forth, does 
not earn them IQ points in the various areas 
of general knowledge that are tapped by con- 

Actually, the great store of 


ventional tests. 

anxiety with which they must cope and the 
kinds of defense mechanisms they employ 
make it impossible for them to benefit from 


contacts with people and events in their en- 
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vironment, and even the schizophrenic child 
who performs feats of memory in some par- 
ticular area of concern or who seems to know 
a great deal about the physical universe or 
certain aspects of modern technology is un- 
able to give an outstanding performance on 
intelligence tests. As for the over-all group of 
disturbed children, clinical psychologists who 
have tested them affirm that the majority are 
functioning considerably below their optimal 
level. Before being admitted to the Bradley 
Home, each child has to be evaluated as pos- 
sessing the capacity for at least average intel- 
lectual functioning. That is, the psychologist 
must judge that even though the child tests 
subnormal (sometimes falling even into the 
“mental defective” category), basically, he is 
of normal or higher intelligence. The fact that 
as a group their intellectual functioning is 
greatly impaired is further demonstrated by 
the finding, mentioned above, that they per- 
form so much worse than do their mothers. 
It seems unlikely that such discrepancies 
would be found between groups of normal 


children and their parents. In fact it seems 
highly plausible that, 


e ectual functioning in 
children. Undoubtedly, this state of affairs 


must set up a vicious circle, with disturbance 
leading to increasing intellectual failure and 
frustration, and the inability to achieve in- 
tellectual mastery leading to greater emo- 
tional maladjustment. In a residential treat- 
ment center, the therapeutic approach is from 
both points; with child care workers and 
recreational personnel helping the child to 
acquire increasing skills and abilities, special 
school teachers providing individualized and 
understanding teaching, and psychotherapists 
working with the child’s emotional conflicts, 
The goal, of course, is to acquire emotional 
and intellectual light where now there is dark- 
ness. Objective knowledge of the intellectual 
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and emotional fruits to be derived from these 
therapeutic efforts awaits much further in- 
vestigation, but there is no doubt that these 
children are deserving of the scientific and 
clinical investment. 


Summary 


The purpose of this investigation was to 
study the intellectual functioning of 70 hos- 
pitalized emotionally disturbed children, of 
whom 12 were schizophrenic and 58 were 
suffering from other types of severe disturb- 
ance, and to compare the children’s intelli- 
gence with a measure of their mothers’ in- 
telligence based on performance on the Wechs- 
ler-Bellevue scales. A significant positive 
correlation was found between the IQs of 
nonschizophrenic children and the IQs of 
their mothers, but no association was found 
between the IQs of the schizophrenic chil- 
dren and their mothers, Both groups of chil- 
dren received IQs significantly lower than did 
the groups of mothers, Although the mothers 
of the nonschizophrenic children received a 
mean IQ that was higher than the mean for 
the general population, the mean IQ of 122 
for mothers of schizophrenic children was 
significantly higher. In comparing the two 
groups of children, it was found that the 
schizophrenics received significantly lower 
IQs, and that the mean IQ for this total sam- 
ple of disturbed children fell at the bottom of 
the normal range of intelligence. Some theo- 
retical, therapeutic, and practical implications 
of these findings were discussed. 


Received June 27, 1957. 
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Some Personality Correlates of Subjects Who Fail 
to Appear for Experimental Appointments’ 


Allan H. Frey and Wesley C. Becker 


University of Illinois 


In the course of an experiment using two 
extreme groups, introverts and extraverts, the 
characteristics of Ss who failed to appear for 
an appointment with or without notifying the 
experimenter were investigated. 

Five of the Guilford personality scales, So- 
ciability, Rathymia, General activity, Social 
ascendance, and Emotional stability, were ad- 
ministered to a large section (250) of intro- 
ductory psychology students. These tests were 
scored, and a group of introverts and a group 
of extraverts were selected by the experi- 
menter on the basis of extreme Rathymia 
scores. Appointments were then made for 
each member of these groups by the use of 
postal cards, 

Twelve Ss notified the 


experimenter that 
they would be u 


nable to keep the appointment 


cone N); fourteen Ss failed to appear 
without notifying the ex eri t 
A ane Perimenter (Group 


group was characterized by low 
Scores on scales S, R, G, and A; the F group 
by high scores. The chi-square test indicated 
that these differences are significant at the 
.01 level, except R, which is significant at the 
.001 level. There was no significant difference 
between groups on the C scale, nor was there 
a significant difference within or between 
groups with regard to sex. According to 
Eysenck, the S, R, G, and A scales are all 
highly loaded on a second-order factor which 
has been called extraversion—introversion. 
The results of this study indicate that a 


1An extended report of this study may be ob- 
tained without charge from Allan H. Frey, Depart- 
ment of Psychology, University of Viris, Urbana, 
Il., or for a fee’from the Americar jDocumentation 
Institute. Order Document No. 5537, renfitting $1.25 
for microfilm or $1.25 for photocopies. 


sampling bias occurs when Ss are obtained by 
the method noted above. This bias could have 
undesirable effects in many kinds of experi- 
ments. For example, in several recent studies, 
Eysenck has been attempting to relate extra- 
version—introversion to such variables as de- 
gree of satiation, conditionability, and remi- 
niscence in pursuit rotor learning. Sampling 
bias of the kind indicated above would tend 
to attenuate any true relationships between 
these variables and extraversion-introversion. 
Of course, the generalizability of any findings 
is also affected. It is suspected that such bias 
would also enter most studies of conformity 
behavior, group dynamics, and anxiety. Anx- 
iety studies enter the picture because of 
their correlation with extraversion—introver- 
sion. Franks reported an 7 of — .48 between 
Rathymia and the Taylor Anxiety scale. 
Farber eż al. reported an r of — .36 between 
the same two tests. The present writers found 
a correlation of — .32 between Cattell’s Anx- 
iety scale and Eysenck’s Extraversion scale. 
It therefore seems likely that selective sam- 
pling on extraversion would encompass to a 
lesser degree selective sampling on anxiety. 

Tn practice, we have found it possible to re- 
schedule the V subjects, but unless consider- 
able pressure is exerted on the F subjects, 
they rarely appear when rescheduled. In ex- 
periments where extraversion—introversion 35 
suspected as an important factor, it is sug- 
gested that pretesting on this variable be ca- 
tied out while Ss are in a “captive” state, €-8» 
in the classroom, and that special pressure be 
exerted to obtain cooperation from the e%- 
treme group members, 


Brief Report. 
Received January 2, 1958. 
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Normative Data and Factor Analysis on the Parental 
Attitude Research Instrument’ 


Marvin Zuckerman and Beatrice Barrett Ribback 
Indiana University Medical Center 


Irwin Monashkin and James A. Norton, Jr. 
Purdue University 


The Parental Attitude Research Instrument 
(PARI), developed by Schaefer and Bell (3), 
Consists of 23 five-item scales. Each scale 
Measures an attitude which is theoretically 
relevant to personality development in chil- 
dren. The test items are modeled after the 
type of items developed by Mark (2) and 
Shoben (4) in their studies of parental atti- 
tudes. The items are general opinions with 
Which the subject is asked to strongly or 
mildly agree or disagree on a four-point scale. 
An attempt was made to increase the social 
acceptability of items by putting them in the 
form of rationalizations, truisms, and cliches. 
The names of the 23 scales can be found in 
Table 4. 

Schaefer and Bell’s normative multiparae 
sample was 100 wives of military personnel 
who were given the test one to four days fol- 
lowing delivery at a military hospital. There 
are two limitations to the representativeness 
Of this sample: (a) the selectness of the occu- 
Pational group and (b) the possibility that 
the expressed parental attitudes may have 
been influenced by the recency of parturition. 

The senior author is engaged in a series of 
Studies on parental attitudes in various groups 
of women including mothers of disturbed chil- 
dren. In collecting a normative sample we had 
four purposes: (a) to provide stanine scores 


+The authors would like to thank Donald T 

oore, Superintendent of Carter Memorial Hospital, 
for his kind permission to use the facilities of Carter 
apita to collect data from patients Á 

others. A note of thanks is extegide 
esheers for his assistance in the mi BME 
actor analysis. t 
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for future work, (b) to investigate four pos- 
sible influences on parental attitudes: age, 
education, number of children, and religion, 
(c) to obtain data for a factor analysis of 
the 23 scales, and (d) to provide a pool of 
control subjects for comparisons with other 
groups of mothers. 

In order to facilitate interpretation in com- 
parisons between different groups of mothers, 
it was deemed desirable to determine the fac- 
torial structure of the test. Schaefer and Bell 
analyzed the factorial structure of the test on 
their normative group of 100 mothers using 
the grouping method of factoring without ro- 
tation of axes. Their results revealed three 
factors in the test: Factor I included 16 of 
the 23 scales and seemed to be a controlling- 
authoritarian factor; Factor II included four 
scales and seemed to be a hostility-rejection 
factor; Factor III included three scales and 
seemed to be a democratic-equalitarian fac- 
tor. The purpose of our factor analysis was to 
derive a single factorial structure from hetero- 
geneous groups which would be useful in com- 
paring factor scores across such groups; and 
to see if the factorial structure derived from 
such a heterogeneous sample would be similar 
to that obtained by Schaefer and Bell from a 


simple normal sample. 


Procedure 


Normative Dat. 


i ample was composed of 
gelu ing mothers of nursery 


per 
anh NOAE mofhers of young adults at- 
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RE fhe. yoke 3 AA 
0 HA tending a nightextention college, and mothers 
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contacted at meetings of church social groups. 
Relevant data on this sample appears in 
Tables 1-3. Using church social groups gave 
us the advantage of being able to secure “cap- 
tive” groups, thus avoiding the selective ef- 
fects entailed in using volunteers. However, 
use of these groups may introduce another 
selective factor since they comprise slightly 
over one-half of the normative sample. In ad- 
dition, it should be noted that the sample is 
drawn exclusively from an urban, midwestern 
population. It contains a greater representa- 
tion of women with some college education 
and a greater proportion of older mothers 
than is found in the general population. The 
religious and racial proportions of the sam- 
ple are not too deviant from those of the gen- 
eral population. 


Factor Analysis 


The following subjects were added to the 
normal group of 222 to comprise the sample 
for the factor analysis: (a) 60 mothers who 
were psychiatric patients in an acute treat- 
ment hospital, (b) 69 mothers of young adult 
psychiatric inpatients, and (c) 62 mothers of 
children referred for examination to two child 
guidance clinics and a children’s inpatient 
Psychiatric service. The total V for the factor 
analysis was therefore 413, The mean educa- 


Table 1 


Education Distribution of Normative Sample 
(M = 12.73 SD = 2.79) 


Grades N % 
0-6 4 
7 5 3 
8 13 6 
9 6 2 
10 6 2 
11 9 4 
12 79 36 
13 17 8 
14 22 10 
15 11 5 
16 44 20 
17 2; 1 
18 2 1 
19 1 1 
20 1 1 
222 99 
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Table 2 


Age Distribution of Normative Sample 
(M = 37.94 SD = 8.71) 


Age N % 
0-19 1 0 
20-24 5 2 
25-29 25 11 
30-34 59 27 
35-39 47 21 
40-44 40 18 
45-49 24 11 
50-54 9 4 
55-59 7 3 
60-64 3 1 
65-70 2 1 
222 98 


tion of this sample was 11.9 years, SD 2.9. 
The mean age was 38.6, SD 10.1. 

Scores of all 413 subjects were punched on 
cards and intercorrelated on the 650 IBM 
machine at Indiana University. The largest 
absolute value of the correlations in each 
column of the matrix was used as the com- 
munality estimate for the scale. The matrix 
was factored, using the principal axes solu- 
tion, on Purdue University’s Datatron com- 
puter. The first three principal components 
accounted for a total of 11.96 out of an esti- 
mated communality variance of 13.57. It was 
decided, tentatively, to stop with three fac- 
tors, since the principal components after the 
third (which were also computed) added only 


Table 3 
Number of Children, Distribution in 
Normative Sample 
(M = 2.53 SD = 1.46) 


z 
= 
x 


0 6 3 
1 46 21 
2 76 34 
: 48 22 
4 28 12 
5 5 2 
6 11 5 
8 1 0 
9 1 0 

222 99 
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Table 4 
Means, SDs, and Stanine Scores for the PARI 
(N = 222) 

Scale 9 8 7 6 5 4 3 2 1 Mean SD 
1 Encouraging Verbalization 5-14 15 16 17 18 19 20 — = 17.93 195 
2 Fostering Dependency 20-17 16-15 14 13-12 11 109 87 6 5 10.82 3.08 
3 Seclusion of the Mother 20-18 17-16 15-14 13 12-11 10-9 8 7-6 5 11.39 3.38 
4 Breaking the Will 20-17 16-15 14 13-12 11-10 9 8-7 6-5 — 10.54 3.29 
5 Martyrdom 20-16 15-14 13 12-11 10-9 8-7 6 5 — 9.44 3.54 
6 Fear of Harming the Baby 20-19 18 17-16 15-14 13-12 11 10-9 8-7 6-5 12.81 3.40 
7 Marital Conflict — 20 19-18 17-16 15 1413 12-11 10 9-5 15.04 3.33 
8 Strictness 20 19-18 17 16-15 14-13 12 11-10 9 8-5 13.71 3.22 
9 20 19-18 17 16-15 14 13 12-11 10 9-5 14.22 2.81 


Irritability 

10 Excluding Outside Influences 
11 Deification 

12 Suppression of Aggression 

13 Rejection of Homemaking Role 20-18 17 5 
14 Equalitarianism 


10.90 3.54 


20 19-18 17-16 15-14 13-12 11 10-9 8-7 6-5 12.80 3.69 


12-11 10 9-8 7 6 5 10:03 2.75 
14-13 12-11 10 9-8 7-6 5 11.62 3.23 
16 17 18 19 20 — 17.40 2.03 


12-11 10 9-8 7-5 12.84 3.02 


15 Approval of Activity T 
16 ae aoe of Commranjeation 20-17 16-15 14 13-12 11 109 87 6 5 10.81 3.20 
17 Trosncidertenese of Husband 20-19 18-17 16-15 1413 12 11407 9-8) 7-6 (5 alone 
18 Suppression of Sex 20-14 13 12-11 10 9-8 7 65 — — 871 2.97 
19  Ascendance of the Mother 20-19 18-17 16-15 14-13 12-11 10 9-8 7-6 5 11.83 3.55 
20 ‘THtrisiveness 20-17 1615 14 15-12 11-10 98 76 5 — 1039 3351 
21 Comradeship and Sharing 5-15 16 17 18 19 3 H oa Sitter 1386 
22 Acceleration of Development 20-18 17 16-15 14-13 12-11 10-9 F A aa an 
23 Dependency of the Mother 20-18 17 i645 WIS 12 U0 9S 00 3. 


small amounts to the total of explained vari- 
ance. This decision was confirmed by exami- 
nation of the residuals after the three factors: 
of 276 residuals, only seven were over 10, 
the largest being .16. It was felt that this 
was well within the sampling variation of the 
original correlations (for 400 df, the 5% level 
for significance of difference is .098). Or- 
thogonal rotations were carried out on the 
factor matrix using the single plane method 
(actually only one rotation in the plane of 
the second and third components seemed in- 


dicated). 
Results and Discussion 


Normative Data 


The scales and their means, standard devia- 
tions and stanine scores derived from the nor- 
mal group, are given in Table 4. The cartels 
tions of the scales with age, education, an 
number of children are given in Table 5. The 
education of the mother seems to be the most 
Significant variable of the three, relating to 
parental attitudes. Using the one per cent 
level for significance, education correlates sig- 


nificantly with 18 of the 23 scales, age with 
six of the scales, and number of children with 
none of the scales. The direction of the cor- 
relations indicate that the less educated and 
older mothers tend to have more severe atti- 
tudes (e.g, more authoritarian, suppressive, 
hostile) on the scales which are related. 
Samples of 38, equivalent in age and edu- 
cation, were taken from each of two religious 
groups, Catholic and Protestant. Comparisons 
of the means on the individual scales were 
made using simple analysis of variance. A sig- 
nificant difference was found only on Scale 7, 
Marital Conflict, on which the Catholics 
scored significantly higher. However, one dif- 
ference out of 20 tests might be expected by 
chance; therefore, we must not conclude that 
religion (Catholic and Protestant) is a sig- 
nificant influence on parental attitudes as 
measured by the PARI. It might be noted, 
however, that there exists a rather homo- 
geneous culture in this area. Differences be- 
tween religious groups may be greater in sec- 
tions of the country where there is less homo- 
geneity of culture. The size of the samples 


vm, 
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also limits any broad conclusions drawn from 
these data. 


Factor Analysis 


The correlation matrix of the 23 PARI 
scales, education and age, based on the total 
N of 413, can be seen in Table 6. The figures 
in the diagonals are the communality esti- 
mates. The unrotated factor matrix can be 
seen in Table 7 and the rotated factor matrix 
in Table 8. 

The three factors extracted in this study 
are very similar to those found by Schaefer 
and Bell, with some minor exceptions which 
will be noted in the discussion of Factor B. 
Thus, the factor structure over a clinically 
heterogeneous group of mothers appears to 
be substantially the same as that obtained on 
normal mothers only. 

Factor A has loadings of .60 and above on 
16 of the 23 scales. The significant loadings 
are on the same scales as found in Schaefer 
and Bell’s Factor I. The loadings are gener- 
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ally higher in this study, probably reflecting 
the greater heterogeneity of our sample. The 
scales which contribute most heavily to this 
factor are those which measure authoritarian, 
suppressive, punitive, and restricting types of 
attitudes. However, this factor is so broad 
that it may be measuring a general response 
set to the test as well as specific response to 
the content of the scales. Education has a 
negative loading on this factor indicating that 
the more highly educated mothers are more 
likely to score low on this factor. 

Factor B is similar to Factor II in Schaefer 
and Bell’s analysis except that Scale 8, Strict- 
ness, no longer is part of the factor. Factor B 
is defined mainly by the two scales, 9 and 13, 
Irritability and Rejection of the Homemak- 
ing Role. Scale 7, Marital Conflict, shows a 
smaller loading on this factor. The character 
of this factor can be described as hostility to- 
ward children and husband and rejection of 
the maternal role. Unlike Factor A, this fac- 


Table 5 
Correlations Between PARI Scales and Age, Education, and Number of Children* 


Scale 


Encouraging Verbalization 
Fostering Dependency 
Seclusion of the Mother 
Breaking the Will 
Martyrdom 

ear of Harmin; 
Marital Conflict endy 
Strictness 
Fa Irritability 

Excluding Outside I 

11 Deification iio 
12 Suppression of Aggression 
13 Rejection of Homemaking Role 
14 Equalitarianism 
15 Approval of Activity 
16 Avoidance of Communication 
17 Inconsiderateness of Husband 
18 Suppression of Sex 
19 Ascendance of the Mother 
20 —Intrusiveness 
21 Comradeship and Sharing 
22 Acceleration of Development 
23 Dependency of the Mother 


CONAN EWHe 


Education Age No. of children 
15 05 —.20 
—.34* Ai. 07 
—.47* 14 19 
-41 13 14 
—.41* .09 .04 
—.31* 08 —.03 
—.21* 04 18 
—.25* .17* dt 
—.08 —.14 23 
—.46* 16 19 
—.37* 01 18 
—.27* 02 07 
= —.04 .03 
‘12 Ad —.05 
—.26* .17* 10 
—.39* .29* 02 
— 29% .18* 01 
— 43* .22* 00 
— 32* 
a -12 08 
— 81 00 00 
—.01 02 10 
—.42* .23* 10 
—.29* O1 00 


* Significant at or below the .01 level. 


a Number of children was not available for part of the normativ 


tions given for age and education are based on an N of 222. 


Correlations for Ni 


e Sample at the time the correlations were run, The correla- 


9. of Children are based on an N of 125. 


a.) = 
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Table 7 


Unrotated Factor Matrix 


Factor 

Scale See 
No. Name I IL m h? 
1 Encouraging Verbalization —.18 37 —.40 33 
2 Fostering Dependency 71 =A0 =i 53 
3 Seclusion of the Mother 76 —.08 =10 59 
4 Breaking the Will 77 04 08 .61 
5 Martyrdom 77 —.04 18 63 
6 Fear of Harming the Baby 66 22 09 8 
7 Marital Conflict 39 36 07 29 
8 Strictness 54 09  —.13 31 
9 Irritability .21 -60 St 52 
10 Excluding Outside Influences -80 —.15 —.01 67 
11 Deification .14 —.12 —.06 56 
12 Suppression of Aggression 65 —.15 00 45 
13 Rejection of the Homemaking Role 31 53 33 -48 
14 Equalitarianism .07 .49 —.40 40 
15 Approval of Activity .70 10 —.13 1 
16 Avoidance of Communication 70 06 05 49 
17 Inconsiderateness of the Husband 63 17, 10 43 
18 Suppression of Sex 78 —.26 03 67 
19 Ascendance of the Mother -72 08 —.02 53 
20 Intrusiveness 73 —.19 —.02 58 
21 Comradeship and Sharing 14 3t = 49 35 
22 Acceleration of Development 74 —.08 —.14 57 
23 Dependency of the Mother 66 13 07 45 
24 Education —.58 .22 .07 38 
25 Age 28 11 -2 44 
11.97 
Sum Aij? 9.37 1.61 0.98 11.96 


tor seems to be unrelated to the education of 
the mother. 


Factor C is identical to Factor III in the 
Schaefer and Bell analysis and consists of 
three scales: 1, Encouraging Verbalization; 
14, Equalitarianism; and 21, Comradeship 
and Sharing. Factor C can be described as 
measuring democratic attitudes toward child 
rearing. Theoretically, one would not expect 
to find this as an independent factor since 
these scales should load on the negative side 
of Factor A, Authoritarianism. Apparently, 
some mothers score high on both of these fac- 
tors which are somewhat contradictory in 
content. Perhaps the acquiescent response set, 
discovered in the F scale by Bass (1), may 
be responsible for this result. Many mothers 
may agree with contradictory statements þe- 
cause of the tendency to agree with any sort 
of positive sounding generality. Acquiescent 


response set on the PARI is currently being 
investigated by the senior author.? 


Summary 


Normative data on the Parental Attitude 
Research Instrument were gathered from 222 
mothers. Stanine scores for the 23 scales were 
derived from the data. Correlations were done 
between the scales and the education, age, a” 


2 Subsequent to this factor analysis of the total 
heterogeneous sample, separate factor analyses were 
carried out on the group of 131 mothers of disturbe 
children and adults and on the group of 222 mothers 
of normals. Although the Correlations between scales 
were higher in the group of mothers of distur 
children and adults than in the mothers of normals 
Factors A, B, and C emerged from each analysis 3” 
were defined by essentially the same scales as 
Ported in the analysis of the total sample, These ti 
sults indicate that the obtained factors are stable 
over two different samples and may be used for com 
parisons between similar criterion groups. 


re, 
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Table 8 
Rotated Factor Matrix 


Scale 
No. Name A B fe h? 
1 Encouraging Verbalization —.18 .07 55" 34 
2 Fostering Dependency 71 —.15 .03 53 
3 Seclusion of the Mother 76 —.12 03 59 
4 Breaking the Will 77+ .08 —.04 61 
5 Martyrdom 77 .07 —.17 -63 
6 Fear of Harming the Baby 66. .23 .05 AS 
7 Marital Conflict 39 34 15 + 20 
8 Strictness 54 -00 15 31 
9 Irritability oo 69+ .07 52 
10 Excluding Outside Influences 80. —.12 —.08 67 
11 Deification 74: —.14 —.02 56 
12 Suppression of Aggression 655 —12 —.09 45 
13 Rejection of the Homemaking Role 31 62° 03 AS 
14 Equalitarianism 07 ote -60 40 
15 Approval of Activity 70 .00 .16 „51 
16 Avoidance of Communication 70, .08 —.01 49 
17 Inconsiderateness of the Husband s . a :07 F 
18 Suppression of Sex Pa = =j 3 
19 PARERA of the Mother Ti -06 .07 53 
20 Tntrusiveness Tp att —.09 58 
21 Comradeship and Sharing 14 -03 58- = 
22 Acceleration of Development 14' — AS a ne 
23 Dependency of the Mother 66° 14 o7 38 
24 Education > EA E i1 V4 
25 Age 11.97 
9.37 1.40 1.20 11.97 


number of children of the mother. The edu- 


cation of the mother was most significantly 
related to scores on the scales. Age showed a 
smaller number of relationships, and number 
of children no significant relationships with 


the scales. 


The scales were factor analyzed using 4 


heterogeneous sample composed of the 222 
mothers in the normative sample, plus 131 
mothers of psychiatric patients and disturbed 
children and 60 mothers who were psychiatric 
patients. Three factors were extracted from 


the test: 


1. Factor A, Authoritarian-Control 
2. Factor B, Hostility-Rejection 
3. Factor C, Democratic Attitudes 


The influence of response set on the test 


was considered. 


Received July 1, 1957. 
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A Self-Scored Projective Measure of Achievement 
and Affiliation Motivation’ 


Richard deCharms 


Washington University 


The measure of motivation recently devel- 
oped by McClelland eż al. (1) for experi- 
mental purposes has the disadvantage of re- 
quiring a careful content analysis of projec- 
tive materials. The procedure to be described 
here was developed with the aim of obtaining 
quickly a motive score that is as close to the 
score derived from content analysis as pos- 
sible. 

Each S wrote six stories in response to six 
picture stimuli under the standardized condi- 
tions described by McClelland eż al. (1). S 
was then given a form containing several sam- 
ple story plots for each stimulus picture and 
asked to rank order their similarity to his own 
story. A score was derived from this form by 
totalling the rankings of motive relevant plots 
fa the latter form. These “self-scored” mo- 

lve scores wer i 
ried fen Eonar analy lae] scores de- 

S “ e original 
stories written by S. 

Achievement motivation. Scores for three 
groups of Ss (total N = 183), were obtained 
from the self-scored measure by totalling the 
rankings of achievement related plots. Analy- 
sis of variance of the means of the content 
analysis measure classified as high, medium 
and low by the self-scored measure demon. 


1An extended report of this study may be ob- 
tained without charge from Richard deCharms, 
Graduate Institute of Education, Washington Uni- 
versity, St. Louis 5, Missouri, or for a fee from the 
American Documentation Institute. Order Document 
No. 5536, remitting $1.75 for microfilm or $2.50 for 
photocopies. 


strated that the means differed significantly 
in all three groups (p < .001). For a fourth 
group (N = 47), the self-scored measure of 
achievement motivation discriminated signifi- 
cantly between volunteers and nonvolunteers 
for a psychological experiment. The content 
analysis score has previously been shown to 
be related to volunteering. 

Affiliation motivation. Scores for three 
groups (total V = 128) were obtained from 
the self-scored measure by totalling the rank- 
ings of the affiliation related plots. Analysis 
of variance of the means of the content analy- 
sis measure classified as high, medium, and 
low by the self-scored affiliation measure dem- 
onstrated that the means differed significantly 
in all three groups (p < .025). 

The self-scoring procedure should not be as 
sensitive and reliable as actual content analy- 
sis. It will, however, yield an immediate score 
which could be used to identify Ss with high 
or low motive scores, and will be especially 
valuable where the test could be administered 
to a large number of Ss from which extremes 
could be drawn. Since much of the work of 
scoring has been eliminated, the new measure 
will allow the researcher to use more Ss or to 
replicate results. 


Brief Report. 
Received December 14, 1957. 
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Asynchronism and Apparent Movement Thresholds 
in Brain-Injured Children’ 


Henry J. Mark 


Department of Otolaryngology, Johns Hopkins University 


and Benjamin Pasamanick 
Department of Psychiatry, Ohio State University 


This paper reports some differences in fo- 
veal asynchronism and apparent movement 
thresholds, and peripheral two-point and ap- 
parent movement thresholds, found between 
brain-injured (pyramidal tract damaged) and 
control children. The results were obtained in 
the course of a larger study aimed at discover- 
ing neuropsychological measurements which 
might be used to detect otherwise unnoticed 
alterations in cerebral functioning. Previous 
studies by Klein and Krech (4) and Eysenck 
(3) demonstrated altered figural after-effects 
in brain injury, and studies with the same 
Subjects (Ss) as those reported here with 
critical flicker fusion (CFF) (8) and light 
Perception (7) threshold measurements sug- 
Zest that visual threshold measurements may 
be sensitive to the effect of nonoccipital lobe 
lesions, 

Asynchronism threshold measurements were 
selected for study here to determine whether 
lowered visual efficiency and increased intra- 
individual variability in the brain-injured 
could again be demonstrated as in the previ- 
ous studies with these groups (7, 8). Appar- 
ent movement threshold measurements were 
selected for study because an explanation of 
the phenomenon of apparent movement usu- 


1 This research was supported by the Alfred P. 
Sloan Foundation, Inc. grant to the Division of 
Laryngology and Otology, Department of Surgery, 
Johns Hopkins University, as well as by a grant 
from the Foundation for Mentally Retarded and 
Handicapped Children of Baltimore. The authors 
wish to thank Paul Meier for invaluable assistance 
and advice, and both Bernard Weiss and Victor 
Laties for their critical reading of the manuscript. 


ally invokes one form or another of a stimu- 
lus after-effect or stimulus surround-effect 
theory. By presenting binocular stimuli in 
homonymous half fields, Birch and Ash- 
dourian (2) demonstrated that central mecha- 
nisms by themselves are capable of produc- 
ing an apparent movement (phi) phenome- 
non. Since central mechanisms are involved, 
such mechanisms may then give rise to dif- 
ferences in apparent movement thresholds be- 
tween brain-injured and control groups. In 
addition, peripheral mechanisms such as reti- 
nal facilitation (9, p. 140), which are known 
to contribute to the perception of the appar- 
ent movement phenomenon, may well be al- 
tered in children whose brain injury has been 
present since birth. This may be hypothesized 
on the basis of epidemiologic studies (5, 6, 
10, 11, 12) which point to anoxia (rather 
than traumatic injuries) as the major cause 
of brain damage. Since the neurons of the 
retina are also susceptible to damage from 
anoxia, altered retinal stimulus after-effects 
or surround-effects may combine with central 
mechanisms to produce apparent movement 
thresholds which distinguish brain-injured 
from control Ss. 


Hypotheses 


Higher asynchronism thresholds, correspond- 
ing to loss of visual efficiency in the detection 
of a pause (p) between the onset time of two 
lights, were predicted in the brain-injured. 
With p as the variable, apparent movement 
thresholds and peripheral two-point thresh- 
olds cannot be readily interpreted in terms of 
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visual efficiency, and the direction of the dif- 
ference between brain-injured and control Ss 
in these thresholds was not specified in our 
hypothesis. Greater intra-individual variabil- 
ity, reported as the V score, was predicted in 
the brain-injured. It was also hoped that dif- 
ferential reactions to peripheral as compared 
to foveal measurements would again provide 
good discriminators between brain-injured and 
control Ss, as it did in two CFF experiments 
(EAS). 


The Experiment 
Subjects 


The brain-injured group was composed of 
ten children (six males, four females) with 
diagnosed pyramidal tract involvement and 
with no primary diagnosed opthalmologic pa- 
thology. The control group was composed of 
ten children (five males, five females) with 
Conditions which did not justify an assump- 
tion of brain damage or injury such as spina 
bifida, hemophilia, or congenital amputation. 
All Ss attended a Baltimore school for handi- 
capped children. The groups were roughly 
comparable in terms of age, IQ, and sex ‘and 
the effects of these covariates on all signifi- 
cant discriminators were examined by means 
of regression diagrams. None of these was 
significantly related to performance. For ex- 
ample, there was no apparent regression of 
thresholds or V scores on IQ (which ranged 
between 64 and 121), and it was therefore 
assumed that IQ did not enter as an impor- 
tant experimental factor in the difference be- 
tween brain-injured and control groups. The 
mean IQ of the brain-injured group was 89 
with an SD of 16; the mean for the control 
group was 96, with an SD of 16. T 
range was between 10 and 15 years, 
median of 12 for both groups. 


he age 
with a 


Apparatus 


Two Sylvania R1131 C glow-modulator 
tubes were mounted centrally on a perimeter 
so that two rectangular focused lines of light, 
each ł-mm wide and 6-mm long, and sepa- 
rated by a distance of 4 mm, could be pro- 
jected by means of a simple achromatic lens 
onto a piece of white plastic mounted on black 
velvet cloth. The glow modulators were acti- 
vated by an electronic pulse-type stimulator 
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and timer (13) which permitted continuous 
variation from 4 ms to 260 ms, of the pause 
(p) between the onset of the two light stimuli. 
The lights were viewed by the Ss from a dis- 
tance of 33 cm. The two lights were matched 
for wave length and had a brightness of the 
order of one-tenth millilambert (0.1 ml) as 
determined with a MacBeth Illuminometer. 
The light stimuli were presented once per 
second with the duration of both stimulus 
lights held constant at 135 ms. For peripheral 
threshold determinations, a 5-mm diameter 
circle of luminous paint served as a fixation 
point. The experiments were carried out in 
total darkness. 


Procedure 


The first binocular foveal measurement was 
always an ascending asynchronism threshold 
(Aase) measurement, where the pause (p) 
between the onset of the two light stimuli 
was continuously increased from 4 ms until 
S reported that the two lights were no longer 
presented simultaneously. As p was further 
increased, all Ss noted movement effects, and 
the ascending apparent movement threshold 
(Mase) was recorded when S reported that 
the observed phenomenon appeared equiva- 
lent to the real movement of one line moving 
from left to right. Similarly, descending ap- 
parent movement (Mpese) and asynchronism 
threshold (Apese) measurements, which may 
be considered simultaneity thresholds, were 
obtained. In this way, six ascending and six 
descending threshold measurements were 0b- 
tained foveally. These were followed by three 
left-eye peripheral threshold measurements. 
With p at 4 ms, each $ was able to distinguish 
two separate lines of light at 15 degrees nasa 
while fixating the 5-mm luminous circle. As P 
was increased, the two lines became blurre 
into a single vaguely defined area, and the 
ascending two-point threshold (TPase) W25 
recorded when S reported he was no longe" 
able to distinguish two separate lines. As P 
was further increased, a left-to-right apparent 
movement of, and within, the vaguely define 
area could be observed, and the peripheral 
apparent movement threshold (Mp) was ™ 
corded when S first reported such a move- 
ment. Then p was decreased until S again 1°- 
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ported two separate lines. This was taken as 
the descending two-point threshold (TPpese)- 

The instructions, aimed at minimizing dif- 
ferences between ascending and descending 
thresholds, follow: 


For Aase: Now you see two lines of light going on 
and off at exactly the same time, exactly together. 
Let me know as soon as you notice that they are not 
going on exactly together any more, let me know as 
soon as you notice that they are out of order even 
the slightest bit. 

For Mase: Now you see two lines out of order, 
Sort of chasing each other. Let me know as soon as 
you cannot see two lines any more. Let me know as 
Soon as it looks just like one line that’s moving 
across from left to right. 

For Mbese: Now you see only one line that is 
Moving from left to right. Let me know as soon as 
you can tell there are two lines again, as soon as you 
Can tell it is not just one line that is moving from 
left to right. 

For Apene: Now you sce two lines blinking out of 
order, Let me know as soon as you notice that they 
are going on and off exactly together, that they are 
Not out of order even the slightest bit. 

For TPase: Keep looking at the blue light (the 
luminous fixation point). Let me know as soon as 
You cannot make out two separate lines any more, 
let me know as soon as it looks just like one blotch 
Of light going on and off. Don’t take your eyes off 
the blue light. 

For Mp: Keep on looking at the blue light. Let me 

ow as soon as the blotch looks like it is moving 
a little from left to right, as soon as it doesn’t just 
seem to go on and off, as soon as it seems to move 
ee a little bit, Don’t take your eyes off the blue 
ight, 

For TPpese: Keep on looking at the blue light. Let 
me know as soon as it no longer looks like just a 
blotch, but as soon as you can make out two sepa- 
Tate lines, or two distinct lights again. Don’t take 
Your eyes off the blue light. 

The estimated threshold for each S in this 
experiment is always the mean of six threshold 
Measurements. The V score is always taken as 
the logarithm of the variance of the distribu- 
tion 2 of measurements around the mean, 1©., 
around the threshold. Nonparametric rank 
distribution of log 


‘ance will depend 
the estimate of 


2A useful property of such a 
variance scores is that their vari 
only on the degrees of freedom in a 
the V score (1). If the psychometric function is 
a cumulative normal curve, then the variance of 
logis? with 5 df is .0938 (if the curve is not a grossly 
non-normal cumulative curve, this is still approxi- 
mately true). This makes it possible to compare the 
Variance obtained for any of the average V scores 
in Table 2 with the known constant variance of .0938 
by the F ratio and establish the significance level. 


methods (14) were indicated in view of the 
sometimes erratic estimates of spread (V 
scores) of the psychometric functions, The 
.O5 level of significance was adopted as the 
criterion for rejecting the null hypothesis of 
no difference between groups. 


Results and Discussion 


Higher average thresholds were found in 
the brain-injured than in the control group 
(Table 1). For ascending asynchronism 
thresholds, it required an average pause of 
44.5 ms for the brain-injured to notice that 
the two lights were not presented simultane- 
ously, while an average pause of only 34.0 ms 
between the onset of the two lights was no- 
ticed by the control group. The difference of 
10.5 ms between the groups is significant at 
the .05 level and supports the hypothesis that 
visual efficiency is impaired in the brain-in- 
jured. The average pause between the two 
lights for the ascending apparent movement 
threshold was 110.8 ms for the brain-injured 
group and 83.9 ms for the controls; the dif- 
ference of 26.9 ms between the two groups is 


significant at the .01 level. 


Table 1 


synchronism Thresholds (AAs and 
Apese), Foveal Apparent Movement Thresholds (Mase 
and Mpe), Peripheral Two-Point Thresholds (TPase 
and TPpes), Peripheral Movement Thresholds (Mp), 
and Foveal-Minus-Peripheral Movement Scores (Mase 
—Mp) in Milliseconds for the Brain-Injured and Con- 


trol Groups of Ten Ss Each 


Average Foveal A 


Brain-injured Control 
Thresholds rd D X SD)” Din 


Foveal 
Aas 44.5 11.2 34.0 8.1 10.5* 
Apvec 33.3: 9:6 30.0 4.9 3.3 
Mase 110.8 20.0 83.9 20.7 26.9** 
Mpese 81.2 10.9 72:1 15.6 9.1 
Peripheral 
TPA» 53.7 17.5 52.8 19.5 9 
TP dese 53.6 10.6 41.6 19.3 8.0 
Mp 92.7 22.0 97.3 32.0 4.6 


Foveal-minus- 
peripheral 


Maso— Mp 18.1 17.8 31.5°* 


—13.4 28.0 


* Significant at the .05 level of confidence. 
#* Significant at the .01 level of confidence. 
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Table 2 


Average V Scores (Log Variance Scores) for Foveal 
Asynchronism (Ase and Apesc), Foveal Apparent Move- 
ment (Mas and Mpese), Peripheral Two-Point (TPase 
and TPpec), and Peripheral Apparent Movement Meas- 
urements for the Brain-Injured and Control Groups of 
Ten Ss Each 


Brain-injured Control 
Thresholds X Fs x Fs 
Foveal 

Ase 2.05 2.62 1.69 2.10 

Adese 2.19** 42 1.74 1.44 

Mase 2.16 5.03 2.11 1.96 

M Deso 2.02 1.55 2.06 2.11 
Peripheral 

TPase 2.44** 78 1.98 1.67 

TP dese 2.49 1.64 2.21 69 

Mp 2.60 1.26 2:23 1.78 


** Significant at the .01 level of confidence. 

* If in fact all Ss within a group had the same intra-individual 
variability for a particular threshold, then Fow) > 1.88 would 
occur only 1 time in 20. gi 


When each S’s peripheral movement thresh- 
old (Mp) is compared with (i.e., subtracted 
from) his own corresponding foveal movement 
threshold (Mace), the brain-injured decreased 
their thresholds by an average of 18.1 ms 
while the controls increased their thresholds 
by 13.4 ms. The difference between the two 
groups in this respect is significant at the .01 
e als that just as in previous 
in actos so Ne in thresholds due 

S may yield good discrimi- 
nators between the two groups, 

Six out of seven average V scores of the 
brain-injured group were larger than those of 
the control group (Table 2). The V scores 
for foveal descending asynchronism thresholds 
and peripheral ascending two-point thresholds 
discriminated between the two groups at the 
.01 level of significance. Such findings through- 
out these studies support one of the major 
hypotheses that the brain-injured show in- 
creased intra-individual variability. 

The visual thresholds in this experiment on 
the whole did not discriminate as sharply be- 
tween brain-injured and control groups as 
did the light perception thresholds of the 
previous investigation (7). In view of the fact 
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that all four V scores associated with the light 
perception thresholds discriminated between 
the two groups at the .01 level, the findings 
here serve to strengthen the major hypotheses 
but hold no additional promise as potential 
diagnostic discriminators. They may be of 
some theoretical interest however. Differences 
in apparent movement thresholds in the previ- 
ously reported experiment, where the exposure 
time of the left light was the only experi- 
mental variable, are readily attributable to 
difference in exposure time required for light 
perception thresholds between the two groups. 
In this study where the pause between the 
two lights was the only experimental variable 
altered, central mechanisms may well have 
contributed to differences between the groups. 
Klein and Krech (4) and Eysenck (3) sug- 
gest that distinct nosological groups have 
characteristic differences in central after-ef- 
fects. Experiments designed to test specific 
figural after-effect hypotheses related to mag- 
nitude, speed of arousal, and persistence of 
after-effects are reported elsewhere (7). 


Summary 


Differences in asynchronism, apparent move- 
ment, and peripheral two-point thresholds 
found between brain-injured (pyramidal tract 
damaged) and control children support the 
two major hypotheses of impairment in visual 
efficiency, and increased intra-individual vari- 
ability in the brain-injured. The possible sig- 
nificance of the apparent movement threshold 
findings is discussed. 


Received July 15, 1957. 
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About Mental Health Problems’ 
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The research reported here grew out of a 
larger program concerning the communication 
of information about mental health to the 
general public.* The first step in this larger 
Program was to learn the state of public un- 
derstanding about mental health problems. In 
order to do this, it was necessary to learn 
what the public thinks about mental health 
problems and to compare this with the opin- 
ions of experts in the mental health field. The 
studies of public opinion are reported else- 
where (1). This paper presents results ob- 
tained from a study of experts. 


Questionnaire Construction 


The term “opinions” refers in the specific 
Sense to segments of verifiable knowledge. 
For example, the statement, “There are more 
men than women in mental hospitals,” is clas- 
ries as an opinion, because it could be veri- 

ed one way or the other, On the other hand 
a statement such as, “I am afraid to be 
papuna anyone who has had a nervous break- 
down,” indicates a personal reaction, or atti- 
tude. The studies of attitude toward mental 
health problems came at a later stage. The 
present study is largely concerned i with 
opinion. 

A measuring instrument was needed which 
was general enough to be used not only with 
diverse segments of the general population, 


1 The research was supported i 
from the National Titis of als Health ey 
Public Health Service. Da ~ 
2J. C. Nunnally and C. E. Osgood ar -di 
of the project. Members of go ee ia 
the time of the research were G. J. Suci, W T 
Taylor, and R. J. Wolf. The research avsistantc 
T. R. Husek and Carol Tucker, gave very helpful 
support to the work. 


but also with mental health experts. For this 


purpose, it seemed most appropriate that the ` 


questionnaire items should be selected from 
the opinions and beliefs currently held by the 
persons in our two sources. Opinion state- 
ments were sampled from a wide collection of 
materials including personal interview data, 
recorded interviews with the mothers of chil- 
dren in psychotherapy, and interviews with 
the relatives of mental hospital patients.* Ad- 
ditional items were sampled from mental hy- 
giene text books and other professional publi- 
cations. Samples of content from the mass 
media—radio, television, newspapers, and 
magazines—were searched for their mental 
health content. For example, when the “psy; 
chiatrist” in one of the radio “soap operas 
advised his patient to take a long vacation, 
this was written down as one opinion about 
ways in which to treat mental health prob- 
lems. In this way over 3,000 statements were 
gathered relating to the causes, treatment, 
symptoms, prognosis, incidence, and socia 
significance of mental health problems. 

The opinion statements which were col- 
lected range from the belief that “insanity 
results from over-eating to the belief Í 
psychiatrists are older than other physicians. 
Only those opinion statements were recorde 
which were expressed in a language the aver- 
age person could understand. Consequently ? 
the sample of opinions largely containe 
simpler and more abbreviated opinions. Thus, 
there may be many opinions of a complex 24 
ture held by mental health experts which have 


For lending us materials for the sampling p 
items, we would like to thank, among others, DR 2 
Campbell, John Clausen, Elliot Freidson, and Shir 
ley Starr. 
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no counterparts in our sample of opinion 
statements. 

The larger collection of opinions was re- 
duced to a group of 240 by removing appar- 
ent duplicates in meaning. The 240 state- 
ments were then cast in questionnaire form. 
A seven-point rating scale was provided for 
each, ranging from “agree” to “disagree.” 
Several examples of the opinion statements 
are: 


Psychiatrists try to teach patients to hold in their 


strong emotions. 
Good emotional habits can be taught to children 


in school as easily as spelling can. 
Adult problems are less important in causing emo- 
tional disorders than the individual’s childhood ex- 


Periences. 


The questionnaire was administered to a 
sample of the general population in the 
Champaign-Urbana area. It was found that 
almost everyone either agreed completely or 
disagreed completely with 60 of the items. 
These were withheld from further analysis. 
The remaining 180 items were subjected to 
factor analysis. The 11 factors obtained in 
this way were used to describe popular be- 
liefs about mental health problems. On the 
basis of the factors, a shortened version of 
the questionnaire was constructed containing 
50 items, The 50-item form was then ad- 
ministered to samples of the population in 
Eugene, Oregon, and in Knoxville, Tennessee. 
This form was also used to study the opin- 
ions of experts. 


The Sample of Experts 


The sample consisted of 300 psychologists 
and psychiatrists in the United States. The 
150 psychologists were randomly drawn from 
the diplomates in the American Psychological 
Association, with 75 of these being taken 
from the clinical section and the remaining 
75 from the counseling and guidance section. 
The psychiatric sample consisted of 150 mem- 
bers of the Group for the ‘Advancement of 
Psychiatry. It was thought that a sample ob- 
tained in this way could be said to represent 
at least a good portion of the expertness M 
psychology and psychiatry. Each person was 
mailed a copy of the questionnaire with a 
slightly different instruction from that used 
in studies of the lay population. Instead of 
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asking each of the experts whether he agreed 
or disagreed with the opinion statements, he 
was asked whether each opinion was worthy 
of being advocated to the public, or used in 
programs of public information. Consequently, 
the experts used a seven-point rating scale 
which ranged from “support” to “repudiate.” 

It was explained to the experts that the 
middle of the continuum would be used to in- 
dicate that a particular idea should be ignored 
in public information efforts. Essentially, the 
experts were asked what messages should be 
conveyed to the public. In the strictest sense, 
the results of the study do not show what the 
experts believe but, more precisely, what they 
think the public should be told. A subsequent 
study of a smaller group of experts using the 
original “agree-disagree” questionnaire form 
showed such a strong correspondence with the 
results obtained from the “repudiate-support” 
form that it is reasonable to assume that the 
experts were responding mainly in terms of 
what they personally believed. 

Returns from the sample were good. Of the 
300 questionnaires mailed out, 201 were re- 
turned, 176 in time for our analysis. The 
group which was analyzed contained the re- 
sponses of 86 psychologists and 90 psy- 
chiatrists. 

Analysis of Data 

The principal reason for getting the expert 
sample was to gauge the public understand- 
ing and to locate the groups in the general 
population whose beliefs appeared to be the 
most anachronistic in comparison to expert 
opinion. These and other findings are reported 
separately (1). The concern here is within 
the expert sample, to find the points on which 
they agree and disagree. First, the mean po- 
sition of each of the three subgroups (two 
groups of psychologists and the psychiatrist 
group) of the expert sample on each of the 
questionnaire items was found. Next, stand- 
ard deviations for the individual items were 
determined over the whole expert sample. 
Finally, a factor analysis was performed on 
22 of the 50 questionnaire items. The par- 
ticular 22 items were chosen because they 
showed the largest standard deviations, or 
disagreement, among experts. 
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Table 1 
Rotated Orthogonal Factors 
Factor 
Item I II IL IV V 
1 .24 .29 00 —.15 03 
2 O01 14 35 —.23 —18 
3 10 27 —.02 14 AZ 
4 —.22 48 03° —.10 —.17 
5 —.03 .00 —.09 35 —.20 
6 18 37 .00 22 05 
7 57 —.03 16 —.04 —.05 
8 40 .08 07 .00 43 
9 -60 03 =a 03 05 
10 .02 34 —.10 —.14 25 
11 -10 .20 08 39 02 
12 —.10 —.12 30 26 01 
13 05 30 17 —.09 04 
14 .22 —.23 21 25 07 
15 —07 .08 35 —.17 .29 
16 04 —.28 10 38 01 
17 —.23 35 20 09 01 
18 43 —.22 00 10 —.10 
19 01 33 18 04 —.06 
20 31 —.04 —.03 —.35 .22 
21 42 —.20 =.11 07 —.37 
22 =19 46 -05 —02 .00 
23 03 23 42 1 .00 
Results 


The worst fear was that the experts would 
show themselves no more in agreement on the 
questionnaire items than members of the gen- 


eral public, This Proved n 
F ` ot to be th : 
‘he item variances o Aa al 


50% of the respondents indicate that a par- 
ticular item should be advocated to the pub- 


one of the “repudiate” categories, positions 1 
2, and 3, on the scale, indicates the percent- 
age of disagreement with the majority de- 
cision. Whereas on half of the 50 items the 
experts show less than 10% disagreement 


4 Variances were averaged over the 50 items for 
experts and the lay population separately. The aver- 
age variance for the lay population was found to be 
2.3 times as large as that for the experts, 
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with the majority decision, the general popu- 
lation shows this degree of agreement on 
none of the items. 

The next concern was whether systematic 
differences would be found between psycholo- 
gists and psychiatrists, or between the two 
groups of psychologists. The average re- 
sponses (the arithmetic means) by psycholo- 
gists and psychiatrists proved to be very 
much alike. Some small differences between 
professions will be shown in respect to the 
factor analysis work. Likewise, the average 
responses by the clinical and counseling 
diplomates were very much alike, with none 
of the differences approaching statistical sig- 
nificance. 

The third consideration was whether there 
was sufficient disagreement on some of the 
items, in the context of generally high agree- 
ment, to point to schools of thought about 
mental health. For this purpose, the 22 items 
which showed the largest variance were 
intercorrelated and factor analyzed ë (see 
Table 1). The product-moment correlation 
formula was used for all coefficients. 

As a twenty-third variable in the correla- 
tion matrix and in the factor analysis, the 
profession of each subject was included. A 
score of 1 indicated that the subject was a 
psychiatrist and a score of 2 indicated that 
the subject was a psychologist.® The profes- 
sional status variable was then factored in 
with the 22 items. The loadings of the twenty- 


©The correlation matrix was factor analyzed by 
the principal axes method (cf. 2), sometimes called 
the principal components method. Communality esti- 
mates were used to fill the diagonal elements of the 
matrix. These were estimated by selecting the high- 
est correlation coefficient, regardless of sign, TE enS 
column of the matrix. The five factors with m 
largest variance were placed through a series © 
single-plane rotations to achieve the orthogonal solu- 
tion in Table 1. Copies of the correlation matrix, the 
unrotated factor matrix, and the questionnaire W1 
be sent on request, Requests should be directed to 
J. C. Nunnally, Department of Psychology, Univer- 
sity of Illinois, Urbana, Illinois. Or the material can 
be obtained by ordering Document No. 5486 por 
the American Document Institute, remitting 
for microfilm or $1.25 for photocopies. A 

6 When the product-moment correlation formula is 
applied to the relationship between one discrete ang 
one continuous variable, the obtained coefficient 1S 
the same as the point biserial coefficient. 
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third variable indicate the extent to which 
one profession is more inclined to believe a 
factor than is the other profession. A positive 
loading means that the factor is held higher 
by psychologists than by psychiatrists. A 
hegative loading means that the particular 
factor is held higher by psychiatrists. 

The most highly loaded items on the first 
factor are: 


Factor I 
Loading Item 

-60 [9] Psychiatrists try to show the mental 
patient where his ideas are incorrect. 

57 [7] The main job of the psychiatrist is 
to explain to the patient the origin 
of his troubles. 

43 [18] The good psychiatrist acts like a 
father to his patients. 

442 [21] Psychiatrists try to teach mental pa- 
tients to hold in their strong emo- 
tions. 

40 [8] Psychiatrists have to have a good 


sense of humor in order to help their 
patients. 


Factor I concerns the psychiatrist’s’ role, 
and, probably, the role of psychotherapists 
generally. More particularly, the factor ap- 
pears to concern the degree of “directiveness” 
that is thought to characterize the effective 
therapist. The items picture the effective 
therapists as teaching, correcting, and ex- 
plaining. The factor illustrates the well-known 
professional controversy between those who 
advocate a more directive, interventionist role 
for the therapist, as opposed to those who 
advocate a role of listening and understand- 
ing. It can be seen from Table 1 that Fac- 
tor I is not more characteristic of psychia- 
trists than psychologists. Variable 23, pro- 
fessional affiliation, has a loading of only .03 
on the first factor. Instead, Factor I demon- 


7 The term “psychiatrist” was used throughout the 
uestionnaire to refer to an expert in the mental 
health field. We would have liked to use different 
titles, like psychiatrist, psychologist, and psycho- 
analyst, but this would have increased the items be- 
yond the number that could be used in survey work. 
In scanning numerous personal interviews, we found 
that the psychiatrist is the person most often men- 
tioned by members of the public as a person who 
deals with mental health problems. Also, we found 
that the public makes little distinction between the 


subprofessions in the mental health field. 
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strates that there is a division of opinion 
within both professions concerning the extent 
to which the therapist should direct and con- 
trol the therapy situation. 


Factor II 
Loading Item 
48 [4] Physical rest will not prevent a men- 
tal disorder. 
46 [22] A change of climate seldom helps an 
emotional disorder. 
37 [6] Adult problems are less important in 


causing emotional disorders than the 
individual’s childhood experience. 
Helping the mentally ill person with 
his financial and social problems will 
not cure his disorder. 


[17] 


be 
on 


The content of Factor II concerns the 
causes of mental disorders and the influences 
that make for better or worse emotional ad- 
justment. Persons who agree strongly with 
these items would seem to favor an explana- 
tion of mental disorder in terms of the indi- 
vidual’s childhood and his history of per- 
sonal experience. A person who held the op- 
posite point of view, one who would disagree 
with the items above, would look for the 
causal factors in the pressures in the indi- 
vidual’s immediate environment. The extreme 
of this point of view would be that the indi- 
vidual’s emotional adjustment is a function 
only of contemporary external influences. 
The extreme opposite point of view would be 
that the immediate environmental pressures 
are of no importance in explaining the indi- 
vidual’s status of adjustment. 

Variable 23, professional affiliation, has a 
small loading of .23 on Factor II. If this 
loading is not due to chance, there is a 
slight tendency for psychologists to endorse 
Factor II more than psychiatrists. However, 
even if the difference between professions is 
real, the difference within professions is the 


far larger consideration. 


8 There are no exact error formulas that can be ap- 
plied to rotated factor loadings. An analogous error 
term can be obtained from the standard error of the 
correlation coefficient. With an N of 176 in this case, 
the standard error would be .076, with a coefficient 
of .19 being significant at the .01 level. By this very 
approximate standard, the loading of .23 would be 
indicative of a real difference between the two pro- 
fessions. 
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Factor III 
Loading Item 
42 [23] Professional affiliation (variable 23 
in Table 1). 
35 [15] A poor diet does not lead to feeble- 
mindedness. 
35 [2] Physical exhaustion does not lead to 
a nervous breakdown. 
30 [12] Most of the time psychiatrists have 


difficulty in telling whether or not a 
patient’s mental disorder is curable. 


Factor III contains most of the common 
variance for the variable of professional af- 
filiation. Rather than being a content factor, 
in which there should be some centralness of 
meaning, the factor contains an array of the 
items that psychologists tend to endorse more 
strongly than do psychiatrists. As mentioned 
Previously, there are few items that differenti- 
ate the professions; and the differences, as 
evidenced in the loadings above, are small. 
The factor shows that psychologists are more 
skeptical of organic and “physical” explana- 
tions of mental disorder; i.e., diet and physi- 
cal exhaustion, than are psychiatrists. The 
last listed item in Factor II, that concern- 
ing the psychiatrist’s difficulties in prognosis, 
perhaps reflects more enthusiasm by some 
Psychiatrists about their clinical prowess than 
would be granted by some psychologists. 


Factor IV 
Loading Item 


39 [11] Mental illness is one of the most 


damaging disorders that a person can 
have, 


38 [16] Most social workers go into their 


field because of their own misfor- 
tunes in life, 

The brains of the feebleminded are 
smaller than those of normals. 
When a person is recovering from a 
mental illness it is best not to dis- 
cuss the treatment that he has had. 


35° [5] 


—35 [20] 


Jum Nunnally 


No sensible interpretation could be found 
for Factor IV. It is submitted to the reader 
for his inspection. 

The loadings on Factor V are too small to 
be considered without additional evidence for 
the statistical stability of the factor. Of the 
common variance explained by the five fac- 
tors, the percentages of variance for each 
were, respectively, 29.8, 28.0, 13.7, 16.6, and 
12.1. 

The findings in this research are restricted 
to the area of opinions being studied. A sam- 
ple of opinions drawn more directly from 
what experts think and say might explain 
more about divisions of opinion in the men- 
tal health field. The most that can be said at 
this time is that there are some differences of 
opinions along the several lines which the 
factors have indicated. Other differences might 
be observable if new items were studied and 
additional factors were found. 


Summary 


The article concerns a questionnaire study 
of the opinions of psychologists and psychia- 
trists about mental health problems. The two 
professions were in agreement about most of 
the issues. A factor analysis was made of the 
combined responses for the two professions. 
Two of the obtained factors demonstrate 
schools of thought about mental health prob- 
lems. A third factor contains a number of 
items which serve to differentiate the opin- 
ions of psychologists and psychiatrists. 
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A number of recent studies have indicated 
that social-psychological variables play a sig- 
nificant role in determining the utilization of 
mental health facilities by members of the 
community (1, 7, 9, 10). While such a phe- 
nomenon is generally in accord with certain 
theoretical expectations (4), it is difficult to 
draw generalized conclusions from the avail- 
able literature. By and large, studies in this 


_ area have dealt with tendencies in specific 


geographic areas and, usually, specific mental 
health facilities. As a result, the data obtained 
may be seriously biased as a function of idio- 
syncratic features of the particular area or 
agency involved. Thus the degree to which 
sources of data are representative of the uni- 
verse to which this data becomes generalized 
is an especially critical issue in studies of this 
type. 

The sampling problem can perhaps be re- 
solved in a number of ways, probably the 
most efficient of which is replication of such 
studies with independent samples in different 
geographical areas. The pooled findings of 
these studies then constitute descriptive steps 
permitting analytic or systematic generaliza- 
tion concerning the sociology and social psy- 
chology of mental health and institutional 
structures in that area. 

1 The authors wish to thank A. V. Cutter, director, 
and the staff of the Guidance Center of Buffalo 


whose cooperation made this study possible. 
2Now with the New York State Department of 


Social Welfare. 


Some Social-Psychological Characteristics 
of a Child Guidance Clinic Caseload’ 


Jack L. Roach? 


Guidance Center of Bufalo 
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and Raymond G. Hunt 


University of Buffalo 


The present investigation then, while not a 
direct replication of any particular study, is 
an attempt to investigate the relationship be- 
tween a number of social-psychological char- 
acteristics found to be of significance by other 
investigators and the caseload of a commu- 
nity child guidance clinic. 


Method 


Case record information was obtained from 
246 cases served in some capacity at the 
Guidance Center of Buffalo during 1954 and 
1955. The Guidance Center is a community 
supported child guidance clinic with services 
available, through an open referral system, to 
the residents of Erie County, New York. Fees 
are adjusted according to ability to pay, there 
being no reason for a family to be refused 
service because of low income. 

The study includes the entire child caseload 
active at some time during the period covered 
with the exception of cases wherein the child 
was not residing with his own parent(s), 
either natural or adoptive. Thus, institution- 
alized or foster-home children were excluded 
from the study. 

Data pertaining to several social-psycho- 
logical characteristics of the families receiving 
clinic services were extracted primarily from 
the application form filled out by the parents 
at intake. As generally happens. in studies of 
this sort, case records do not always yield 
complete information about every case. As a 
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result, in each descriptive category employed 
there was a varying number of cases which 
could not be ordered exactly. After careful 
consideration, however, the authors deem it 
unlikely that the findings reported below 
would be seriously altered were all of the un- 
known cases known. Comparative census data, 
where appropriate, were drawn from the Sta- 
tistical Abstract of the United States (11), 
and from records of the Council of Social 
Agencies of Buffalo and Erie County. 

Seven characteristics presumed to be of 
significance were selected for analysis. These 
were: (a) sex of child, (b) family size, (c) 
occupation of major wage earner, (d) area of 
residence, (e) race, (f) religious affiliation, 
and (g) symptom picture. 

The purpose of the present study was en- 
tirely descriptive (empirical). No attempt was 
made, at this time, to establish relationships 
between any of the variables, though a num- 


ber of interrelations are likely as suggested 
below. 


Results 


; It was found that of the 246 cases included 
in this study, 72% were male. This finding is 
consistent with data reported by several other 
Investigators (1, 7), thus indicating a tend- 
ency toward disproportionate representation 


of males in child guid ini i 
o aal guidance clinic patient popu- 


Table 1 


Occupational Distribution of Major Wage 
Earner in Clinic Families 


(N = 241) 


Source (in per cent) 


KK 

Occupational group Clinic® Census? 
Professional and technical 21 11 
Proprietors, managers, officials 20 12 
White collar, clerical 19 24 
Skilled workers 19 15 
Semiskilled workers 11 31 
Unskilled workers 10 7 
Total 100 100 


Note.—x?% = 24.77, df = 5, p = <.001. 

a Unknowns (7% of total) were distributed among categories 
according to observed distribution of known cases. 

b Census figures refer to New York State (1950), 
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Table 2 


Quartile Ratings of Desirability of Residential Area 
(N = 196°) 


Source (in per cent) 


Quartile Observed 
ranks (clinic) Expected 
I 52 25 
Ir 11 25 
Ill 24 25 
IV 13 25 
Total 100 100 


Note.—x?% = 57.82; df = 3; p = <.001. 
a The bulk of unknown cases (20%) omitted from the 
analysis came from tract areas not rated but primarily desirable 
suburban areas. 


A similar lack of representativeness was ob- 
served with respect to the racial character- 
istics of the clinic population—only 1% of 
which was nonwhite. In both instances, the 
significance (statistical) of the data is ob- 
vious. 

Table 1 reports the results of a comparison 
between the occupational distribution of the 
major wage earner in the clinic population 
and the distribution of such occupations in 
the general population. The classification em- 
ployed was a modification of occupational 
classifications frequently reported in the so- 
ciological literature (2). Farmers and unem- 
ployed workers were excluded from the analy- 
sis owing to the very low frequency of each in £ 
the clinic population (two and three cases, t 
respectively). Moreover, it would be expected 
that few farmers would be represented owing 
to the urban character of the area served by 
the clinic. Hence, to avoid the introduction 
of spurious differences, these groups were 
omitted from analysis. i 
_ Table 1 indicates that the agency is serv- 
ing all occupational groups within the general 
population, but with a considerable overrep- 
resentation of the “upper” occupational cate- 
gories. S 
The data reported in Table 2 were obtained { 
by rating the area of residence of each clinic 
family along a dimension of desirability, 4° 
cording to a quartile scale developed by the 
Council of Social Agencies of Buffalo and 
Erie County (3). This scale is based upon 4 


Table 3 


Religious Affiliation of Clinic Families 
(N = 246) 


Source (in per cent) 
ee 


Religion Clinic* Census? 
Protestant 57 40 
Catholic 32 57 
Jewish 11 3 
Total 100 100 


Note.—x2% = 33.50; df = 2; p = <.001. 
a Unknowns (20%) were distributed according to observed 


frequencies of known cases. Á 
v Census figures refer to metropolitan Buffalo (1955). 


= variety of objective characteristics of census 
tracts in Buffalo and vicinity (€-8- percent- 
age of dilapidated dwellings). It should be 
noted that a rating of I corresponds to “most 
desirable” and a rating of IV to “least de- 

_ sirable.” 

j! It can be seen from Table 2 that a heavy 
proportion of clinic families come from the 
most desirable residential areas. It should be 
borne in mind that the variables summarized 
in Tables 1 and 2 involve dimensions widely 
used as indices of social-class position. 

Data pertaining to the religious composition 
of the clinic caseload are presented in Table 3- 
Both the present study and Anderson and 
Dean (1) agree generally in finding that 
Protestants comprise the largest single clinic 
group. Both this and the Jewish group are 
overrepresented in the present clinic popula- 


Table 4 
Number of Children in Clinic Families 
(N = 246) 
Source (in per cent) 
Number of 
children Clinic* Census 
15 35 
A 41 33 
4 20 18 
4 and more 24 14 
Total 100 100 
= 20.86; df = 3; p? = <.001 


=e - 001. 
eee (3%) were distributed according to observed 
frequencies of known. cases. 


b Census figures refer to New York State (1955). 
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tion, while Catholics are considerably under- 
represented. 

In Table 4 are presented data relating to 
the number of children in clinic families. It 
is clear that the obtained difference is ac- 
counted for mainly by the underrepresenta- 
tion of single child families in the clinic popu- 
lation. It is of considerable interest that only 
15% of the case population is made up of 
“only” children—a finding contrary perhaps 
to expectancies derived from much child de- 
velopment literature (5). 

Table 5 represents a classification of the 
symptomatic picture characterizing the child 
at intake. The classification was developed by 
the authors. Cases were ordered to categories 
on the basis of dominant symptom patterns. 
When no particular type of symptom was 
dominant, the case was classified as “mixed,” 
hence this category is somewhat more hetero- 
geneous than the others. As far as possible, 
ratings were based upon descriptions of the 
child’s behavior provided by the parent(s). 
An effort was made to sift out interpretive 
statements originating with clinic personnel. 
Tt was hoped thereby to lend greater objec- 
tivity to the data. ae 

Evident in Table 5 is the marked incidence 
of children with aggressive behavior as the 
predominant symptom. This seems generally 
consistent with the findings of Stevens (10) 
and of Anderson and Dean (1). Thus, aggres- 
sive and acting-out behavior apparently com- 


Table 5 


Classification of Dominant Symptomatic 
Behavior at Intake 


(N = 246) 

Dominant symptoms Í % 

Aggressive 86 35 
Nonaggressive* 69 28 
Somatic complaints? 23 9 
Mentally retarded® 35 14 
Mixed 25 10 
Unknown 8 4 
Total 246 100 


«For example, withdrawal, daydreaming, “silly behavior,” 
excluding somatic functions when dominant scomplaint. 

b For example, asthma, pains in stomach, when dominant 
complaint. 

c Cases classified here when dominant complaint was retar- 
dation, suspicion thereof, or poor academic performance. 
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prises the largest single basis for clinic re- 
ferral, perhaps because such behavior is most 
disturbing to various cultural agents. 

Finally, it is perhaps worth noting that 
25% of the patient population included in 
this study had had some kind of prior social 
agency contact as reflected by registration 
with the Social Service Exchange. 


Discussion and Conclusions 


A general conclusion which emerges from 
the findings reported here is that the clinic 
from which the data was drawn is not serving 
equally all segments of the population. It is 
clear that the clientele served represents, pri- 
marily, a white, Protestant group of middle to 
high socioeconomic status. Such also is the 
conclusion drawn by other similar studies. 

Further, it is quite conceivable that most 
of the observed instances of unrepresentative- 
ness of clinic populations are a direct func- 
tion of the middle-class character of such 
populations. If, for example, the population 
served is largely middle class, it is not at all 
surprising that nonwhites will form a very 
small percentage of clinic clientele, Likewise, 
the convergence between Protestant and gen- 
eral middle-class values pointed out by many 
writers (Davis, 4; Merton, 8; Williams, 12), 

forms one plausible explanation for the ob- 
served distribution of religious groups in the 
clinic population, 
Cae ae ee that a large percentage of 

uded in the lower social 
classes renders understandable the underrep- 
resentation of this group in the population of 
urban child guidance clinics, although other 
factors might also be operative with regard to 
this group. The same considerations would 
hold, in reverse, as an explanation for the ob- 
served overrepresentation of Jews. 

Similarly, this “middle-class phenomenon” 
might be of considerable significance with re- 
spect to the preponderance of male children 
served (Green, 6), and also with regard to 
the dominant type of symptom patterns ob- 
served. Regarding this latter, it seems likely 
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that instances of acting-out behavior will be a 3 
source of greater concern among middle-class ` 
than among working-class families. 

It thus becomes apparent from a growing 
body of literature similar to the present study, 
that cultural mental health facilities are being 
utilized primarily by middle- and upper-class 


members of society. The independent vari- 
ables determining this phenomenon are as q 
yet, however, not clearly understood and ob- 
viously call for empirical elucidation. 
Received June 24, 1957. 
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The Weighted Q Sort: 


A Procedure for Quantitatively 


Estimating Emotional Disturbance and 
Personality Change’ 


Marvin Reznikoff and Laura C. Toomey 
Institute of Living, Hartford, Connecticut 


While the usefulness of the Q sort has been 
cleirly demonstrated in expressing individual 
personality profiles in quantitative terms, the 
technique is not equally effective for quanti- 
tative representations of personality change or 
degree of emotional maladjustment. In a typi- 
cal application of this forced choice rating 
method, ‘Q-sort personality evaluations are 

_ done on patients before and after therapy 
and the sorts compared. Coefficients of corre- 
lation indicate if personality changes, per se, 
have occurred, but do not reflect quantita- 
tively the direction and magnitude of such 
changes; neither do Q sorts used in this 
manner provide direct estimates of levels of 
adjustment which can be contrasted. Only 
Dymond (3) has published a method for 
quantitatively evaluating adjustment using an 
“external criterion.” Dichotomizing her Q- 
array statements into “adjustment” and “mal- 
adjustment” categories, she arrives at an ad- 
justment score by counting the adjustment 
items characteristic of the patient and the 
maladjustment items not characteristic of him. 

As one aspect of a large project involving 
the evaluation of psychological changes asso- 
ciated with psychiatric treatment, a modifica- 
tion of the Q sort was developed which yields, 
along with the usual personality picture, & 
single composite score revealing degree of 

emotional disturbance. ‘Additionally, this ad- 

justment index” readily lends itself to an 
over-all quantitative determination of perso 
ality change. In contrast to Dymond’s metho 


i igati Office of 
is investigation was supported by the 
Naval Research under Contract No. NONR (00) 
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of broadly classifying items as indicative of 
either adjustment or maladjustment, this pro- 
cedure places items at appropriate points on 
a graduated adjustment-maladjustment scale. 
The modified technique designated as “the 
weighted Q sort” is described in this paper. 


Development of the Method 


As a first step, 2 grouP of clinical formula- 
tions were selected from Beck’s psychody- 


namic outline of schizophrenia (1) and modi- 
fied to some extent. Since Beck’s conceptual 
schema is based solely 07 Rorschach person- 
ality correlates, pertinent clinical formulations 
were also included which could be determined 
more readily from other projective tests, as 
well as from jnformation elicited during thera- 
peutic sessions. Finally, some statements char- 
acteristic of personality in general were added, 
in order to more fully represent the normative 
end of the continuum, and provide a schema 
applicable to nonschizophrenic as well as 
schizophrenic subjects. All 44 clinical state- 
ments were then typed on individual 3” X 5” 
cards and sorted into a seven-category forced 
normal distribution by three experienced cli- 
nicians. These judges, working independently, 
rated these items on a continuum from most 
indicative of severe emotional disturbance 
(Category 7) to least indicative of severe 
emotional disturbance (Category 1). The spe- 
cific sorting instructions provided were: 


Please sort these 44 clinical formulations into seven 
categories. Category 7 is to represent those clinical 
formulations most indicative of a serious psychologi- 
cal disturbance. The clinical formulations in the re- 
maining six categories are to be thought of as pro- 
gressively less indicative of a serious mental disturb- 
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ance with those items in Category 1 considered to be 
least pathological in their implication. The number 
of cards to be placed in each of the categories is as 
follows: 


Category 


765 4 
Number of cards 3 6 0 


S Fa 
8 10 8 6 3 

The correlations between the ratings of the 
three clinicians taken two at a time were .84, 
.75, and .73, indicating a statistically sig- 
nificant degree of agreement (p < .001) in 
evaluating the relative pathological implica- 
tions of the clinical formulations. Using the 
totals of the three independent ratings for 
each of the 44 items distributed in an ap- 
proximate normal curve, a weight or “pa- 
thology score” was assigned to every clinical 
formulation. The three clinical formulations 
having the highest total ratings were each 
given a weight of “7,” designating them as 
most pathological; the six having the next 
highest totals a weight of “6” and so on, with 
decreasing weights representing diminishing 
pathology. The items and their pathology 
scores are: 


Pathology score of 7 (3 items) 
Flight of ideas 
Delusional thought 
Thought processes are regressive, archaic, primitive 
or magical 


Pathology score of 6 (6 items) 
Inappropriate affect 
Metaphysical or philosophical ponderings of a 
vague unproductive nature 
Grandiose 
Withdraws into autistic fantasy 
Confused, illogical thinking 
Erotic gratifications regressive 


Pathology score of 5 (8 items) 
Prominent mood swings 
Disregards social canons 
Intrusion of irrelevant material in thinking 
Projection an important defense 
Suspicious and wary 
Inadequate reality testing 
Free anxiety; intense and sudden in appearance 
with controls failing 
Maladaptive externalized aggression 


Pathology score of 4 (10 items) 
Socially withdrawn 
Primarily identified with opposite sex 
Aggressive, destructive preoccupations 
Interest is dominated by one“or two themes to the 
exclusion of all others 
Impulsive, unstable in reaction to usual life stimuli 
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Intellectual functioning significantly below poten- 

tial 

Denial an important defense 

Ş xual preoccupation 

¿Undoing an important defense 

Depression 
Pathology score of 3 (8 items) 

Blocking J 

Generalized feelings of inadequacy and ineffectual- 

it: 

Toleti an important defense 

Guilt feelings 

Anxiety provoking conflicts expressed in conversion 

symptoms or psychosomatic illness 

Infantile and egocentric ` 

Anxiety persistent and pervasive 

Obsessive-compulsive behavior t 
Pathology score of 2 (6 items) 

Repression an important defense 

Displacement an important defense 

Unrealistic self-concept and level of aspiration 

Reaction formation an important defense 

Passive and submissive 

Characterized by rigidity 
Pathology score of 1 (3 items) 

Rationalization an important defense 

Overconventional 

Limited insight 

A convenient arrangement is to note the ap- 
propfiate pathology score on the back of each 
clinical formulation card. As employed in per- 
sonality evaluation, this weighted Q array is J 
sorted in the ordinary manner. The clinician 
sorts each of the clinical formulations into one 
of seven categories, depending on how charac- 
teristic the description is of the patient. The 
number of items to be placed in each cate- 
gory is predesignated, so that an approximate 
normal distribution, identical with the one 
used for the pathology sort, is obtained. 
Items in Category 7 are those judged most 
applicable to the patient, while the formula- 
tions in Category 1 are considered entirely in- ; 
appropriate descriptions. 

Denoting the category in which a particular | 
clinical formulation is placed in a personality 
assessment as its “applicability rating? a = 
composite adjustment index can be computed ) 
for a patient by simply multiplying each ap- 
plicability rating by the item’s pathology 
score and summing the 44 products. If the 
clinical formulations indicative of the most 
severe pathology are always rated as most 
characteristic of the patient, then a maxi- 
mum total will be obtained, reflecting the 


a 
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greatest degree of disturbance. On the other 
hand, if the items judged as most pathologi- 
cal are consistently scored as Jeast character- 
istic of the patient, the total is minimal, in- 
dicating relatively insignificant emotional dis- 
turbance. The highest possible total for the 
44 clinical formulations using this procedure 
is 722, while the lowest total is 586. A range 
of 0 to 236 can thus be established for the 
oo index by subtracting the constant 


Reliability 


_ Asa check on the reliability of the ad- 
justment index, weighted Q-sort personality 
evaluations done independently on the same 
patients by each author were contrasted. 
These sorts were based on the test protocols 
of 25 patients not tested by either author and 
selected at random from the files. In general, 
the battery of tests available on each patient 
consisted of the Wechsler, Rorschach, The- 
matic Apperception Test, Draw-a-Person Test, 
and the Sentence Completion Test. The cor- 
relation between the two series of adjustment 
indices, calculated from the two independent 
Q sorts for each patient, was 79, which is SIS- 
nificant at .001 level, and indicates that this 
procedure can be used in consistent fashion. 


Validity 
validity of this procedure, 


from the two Q-sort rat- 
ts were aver- 


To determine the 
adjustment indices 
ings for each of the 25 patien 
aged, and the mean ratings were compare 
with estimates of adjustment obtained from 
each patient’s therapist. Each 
chiatrists involved was asked to rate the Pa 
tient as he was at the time of the psychologi- 
cal testing, using The Institute of Living 
Clinical Rating Scale for Attending Physician 
(5). This scale consists of 12 items, each to 
be rated on a five-point scale of jncreasing 
maladjustment. The ratings may b 
to give an over-all estimate of adjustment, 
with a maximum total score of 
ing to maximum maladjustment. 
scores from the therapist ratin; 
to be correlated with the mean 
57,£a result which is significant } 
level. Correcting for attenuation increases this 
correlation coefficient to .66. 
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Discussion 


This modified procedure has a number of 
advantages compared with the conventional 
correlation approach. First, the computation 
of the adjustment index is somewhat less 
arduous than the derivation of a correlation, 
although the latter computation can be sim- 
plified by use of the “method of differences” 
(2, 4). Also, the adjustment index escapes 
certain disadvantages inherent in the 7: the 
potentiality for being mistaken for a percent- 
age, and the complexity of interpretation of a 
measure that may vary in significance. 

But the most important advantage of the 
adjustment index approach lies in its ability 
to compare Q sorts from groups of patients, 
and in its amenability to further relatively 
simple statistical manipulation. Returning to 
the example of contrasting “unweighted” Q- 
sorts personality evaluations done on a num- 
ber of patients prior to and after therapy, 
the method of comparison is a correlation, 
calculated separately for each patient. The 
researcher is thus left with a distribution of 
y’s which may be exceedingly difficult to in- 
terpret. When the weighted Q sort is used, 
however, pre- and posttherapy adjustment 
indices are computed for every patient in the 
manner described previously. A statistical 
test is performed next to determine if the 
mean difference between the two series of ad- 
justment indices is significant. This procedure 
then gives a definitive picture of the scope 
and direction of changes associated with 
therapy- 

The advantage of the index is even clearer 
in the case where two groups of patients are 
to be compared before and after therapy. The 
investigator using correlations would be faced 
with the task of comparing two series of 7’s, 
the before-after therapy correlations for the 
two groups. The 7’s cannot be compared di- 
rectly, but must be converted to 2 values; 
whereas two series of adjustment scores dif- 
ferences could be readily compared by con- 
ventional tests of significance. Furthermore, 
the sign of the index difference immediately 
indicates the direction of change, while direc- 
tion cannot be discerned from the r compari- 


son. 
The weighted Q sort also readily lends it- 


ť— 
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self to a comparative analysis of the ratings 
of psychiatrist and psychologist judges, in 
that the 44 clinical formulations can be rated 
from the results of psychological tests or 
therapeutic interviews. Of particular interest 
would be the use of weighted Q sorts to de- 
termine the degree of agreement between psy- 
chologists and psychiatrists evaluating the 
general adjustment of the same group of 
patients. 

The authors’ experience with the weighted 
Q sort in its present form suggested that aug- 
menting the 44 clinical formulations with ad- 
ditional items would enhance the sensitivity 
of the technique. 


Summary 


A method was described for modifying the 
Q sort so that it could be utilized to estimate 
over-all degree of emotional disturbance and 
also to determine extent of personality change. 
Briefly, the procedure involved weighting 
each of 44 Q-array clinical formulations ac- 
cording to how indicative the specific item 
was of serious pathology. The statements can 
then be sorted, in the usual manner, into 
categories arranged on continuum: person- 
ality descriptions judged most characteristic 
of the patient to be placed at one end of the 


continuum, while those rated as least charac- 
teristic at the other extreme. From the rela- 
tive applicability of the various clinical for- 
mulations to the particular patient and the 
assigned weights of the items, an individual 
“adjustment index” is determined. Reliability 
and validity data with reference to this pro- 
cedure are presented and the advantages of 
using the weighted Q sort’s adjustment indices 
in group comparisons are discussed. 
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Adjustment and Prediction of Others’ Behavior 
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Among the myriad problems in the area of 
interpersonal perception are those concerning 
the characteristics of the individual perceiver 
which affect the adequacy of his perceptions. 
Implicit in many conceptions of maladjustive 
behavior is the notion that the poorly ad- 
justed individual is less able to perceive 
clearly and hence to predict the responses of 
others, However, empirical evidence regard- 
ing the relationship between personal adjust- 
ment and ability to predict is equivocal (5). 
A recent study by Bieri, Blacharsky, and 
Reid (1) hypothesized a negative relation- 
ship between degree of maladjustment and 
accuracy of prediction, as well as a positive 
relationship between degree of maladjust- 
ment and tendency to engage in projection 
(assuming similarity between self and others). 
Neither hypothesis was supported by the find- 
ings; in fact, the obtained relationship be- 
tween degree of maladjustmen 
tion was in the direction opposite from that 
predicted. On the basis of their study, these 
investigators concluded that “better adjusted 
Ss tend to predict most accurately On the 
basis of similarities between thems 
others, while maladjusted Ss em 
greater degree than adjusted Ss accurate pre- 
diction of differences between themselves and 
others” (1, p. 353). 

Some methodological 
suggest, however, an alternative explana 4 
of the findings as has been recently pointe 
out by Erikson (3)- The choic 
Manifest Anxiety Scale as the set of responses 
to be predicted leaves open the possibility 
that Ss in making their predictions could 
have been responding to 4 stereotype of how 
a college student responds. More specifically, 


if most Ss were aware for most items of the 
MAS that certain responses were more “ac- 
ceptable” and probably more likely to occur 
in a college population, the results obtained 
by Bieri, Blacharsky, and Reid would auto- 
matically follow. An S who himself had given 
maladjusted responses would “predict” the 
responses of his target figures to be mostly 
different from his own and consequently a 
high proportion of his accurate predictions 
would be perceived differences. Conversely, 
the well-adjusted S responding in the more 
acceptable and likely manner for himself and 
also responding in this manner for his tar- 
gets would obtain most of his accuracy in 
perceived similarities. Further, in this study 
Ss chose members of their class to predict, 
and since differential acquaintance with fel- 
low class members might be related to the 
variable of adjustment, this procedure could 
easily confound the results of the study. 
The present study is an attempt to test the 
hypothesis that there is a negative relation- 
ship between personal adjustment and ade- 
quacy of performance in predicting the be- 
havior of others. The method used somewhat 
obviates the possibility that Ss can predict on 
the basis of a stereotype and also the diffi- 
culties which may ensue in interpreting re- 
sults where Ss select acquaintances to predict. 


Method 


Fifty-two Ss from two sections of an ele- 
mentary psychology course at the University 
of North Carolina made predictions for their 
respective section instructors. Both groups 
were administered the Rotter Incomplete 
Sentences Blank (4) and a modified group 
form of the Minnesota Multiphasic Person- 
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ality Inventory, which included the Welsh 4 1 
and R Scales (7). At a later time, after ap- 
proximately 35 hours of class meetings, the 
prediction procedure was administered. Ss 
were asked first to respond to the prediction 
schedule for themselyes and immediately after 
to predict how their respective instructor had 
responded to the same items. All experimental 
Procedures were administered by an experi- 
menter ? who had nothing to do with the 
teaching of the course, and Ss were assured 
that their instructors would not see the data 
until after the end of the term. 

The criterion instrument on which the pre- 
dictions were made was constructed by select- 
ing 40 items from the Edwards Personal Pref- 
erence Inventory (2). The inventory is an 
attempt to measure psychological needs by 
means of a forced choice procedure. Each 
item consists of a pair of statements from 
which the individual is to select the one 
most descriptive of him. Each pair of state- 


pairs each from the 
for achievement, af- 
aggression, and autonomy. The 
items was a priori, but with two 
objectives—to Provide a variety of behaviors 
to be predicted and behaviors of a sort that 
Ss would be likely to possess some relevant 
observations from which to make their in- 
ferences. 

The target figures were the instructors of 
the two sections: one instructor was male, one 
female; each section predicted its own in- 
structor. The sections met at the same hour 
and one half of the students enrolled in the 
course had been arbitrarily assigned to each. 
Both instructors had taken the Edwards’ PPI 


1 Welsh suggests that the A ‘scale measures an as- 
pect of maladjustment characterized by anxiety and 
dysphoria. Mr. Carl Cochran, in a doctoral disserta- 
tion in progress, found a correlation between the 
MAS and the Welsh A scale of +.81 for a group of 
514 college students. The R scale was included to get 
at another aspect of adjustment—tendency toward 

ii nd repression, 
athe So wishes to thank Howard Leventhal 
for his assistance in the collection of these data. 
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out of curiosity about six months before the 
present study was suggested. 

Scores for predictive behavior were derived 
in the same manner as in the Bieri, Blachar- 
sky, and Reid study. Predictive accuracy 
scores were obtained by totalling the number 
of agreements between S's predictions and 
the target’s responses. Assimilative projection 
Scores were obtained by totalling the num- 
ber of S’s predictions (accurate and inaccu- 
rate) which coincided with his own responses. 
The latter score was separated into two com- 
ponents: accurate projection, i.e., accurately 
perceived similarities; and inaccurate projec- 
tion. A perceived difference score was ob- 
tained by totalling the number of disagree- 
ments between S’s predictions and his own 
responses. This score was also separated into 
two parts: accurately and inaccurately per- 
ceived differences. In addition, the number of 
teal similarities and the number of real dif- 
ferences between each S and the target were 
totaled. 


Results 


The Welsh scales and ISB yielded distribu- 
tions of scores very similar to those reported 
by the authors for other college populations. 
Two judges independently scored 28 of the 
52 ISB protocols; 
reliability was .89, 
the Welsh A scale and the ISB was .38; be- 


scales for this group is not 
ferent from zero.) 

The prediction 
difficult one. The 
score for all 
a predictive 


task given the Ss was 4 
mean predictive accuracy 
Ss was 22.39 (SD 1.99), Since 
accuracy score of 20 could pre- 
sumably be obtained by chance, a test of the 
significance of the difference between the ob- 
tained mean and 20 was performed (6, P- 
147). The value of ż equalled 7.68 (p < -001; 
df 51). 

The product-moment correlations between 
the various prediction scores and the en 
ures of adjustment are presented in m x 
Fisher’s z transformation was used to test the 
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Table 1 


Relationships Between Measures of Adjustment 
and Prediction Scores 


W = 52) 

Measure ISB Ascale R scale 
Predictive accuracy —.26* 02 eal 
Assimilative projection 05 —.28** 02 
Accurate projection 00 —18 oe 
Inaccurate projection Al — 26° = 
Perceived differences —.05 DBRS —02 
Accurately perceived 

differences - 37 “16 at 
Inaccurately perceived 
differences 16 a? ae 


* Indicates p < .10. 
tk Indicates p < .05. 
** Indicates p < .01. 


significance of the differences between the ob- 
tained 7’s and zero. For all the measures of 
adjustment a high score is indicative of mal- 
adjustment. 

The correlation between predictive accu- 
racy and ISB scores although in the expected 
direction did not quite reach statistical sig- 
hificance (.10 > p > .05). Neither A nor R 
correlated significantly with predictive ac- 
curacy. 

While ISB scores do not correlate with 
tendencies to assume similarity, either accu- 
rately or inaccurately, scores on the A scale 
do seem to be negatively related to inaccu- 
rate projection (assumption of unwarranted 
similarity), meaning that the higher the 4 
score the less likely the person to assume un- 
Warranted similarity between himself and the 
Person predicted for. Although the positive 
Correlation of R with inaccurate projection 
does not quite reach the .10 level, it suggests 
that the independent aspects of eee eae 
measured by the A and R scales are relate 
to tendencies “to see similarities where they 
are not” in quite different ways. Also inspec- 
tion of the relationships between the three 
projection scores and the A and R scales sug- 
gests that while the negative relationship be- 
tween A and inaccurate projection could well 
be largely the result of some general response 
set to assume dissimilarity, the positive re- 
lationship between R scores and inaccurate 
Projection might be independent of such a set. 

ISB scores are not significantly related to 
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over-all perception of differences between self 
and the target predicted; however, they are 
negatively related (p < .01) to accurate per- 
ception of differences, suggesting that malad- 
justed Ss predict differences less well than do 
better adjusted Ss. In contrast, scores on the 
A scale are positively related to over-all per- 
ception of differences, although neither the 
accurate nor inaccurate components of these 
predicted differences correlate significantly 
with scores on the A scale. 

Real differences between S and the pre- 
dicted target correlated with predictive ac- 
curacy — .07, which is not significant. Real 
differences correlated + .02 with scores on 
the A scale and —.16 with scores on the 
ISB. Accurately predicted differences corre- 
lated with real differences + .64. When a 
partial correlation between accurately pre- 
dicted differences and ISB scores holding real 
differences constant is computed the value is 
— 36. 


Discussion 


The above findings do not support Bieri, 
Blacharsky, and Reid’s conclusions, i.e., that 
better adjusted Ss are more likely to predict 
similarities accurately, while more poorly ad- 
justed Ss are more likely to predict differences 
accurately. The obtained results do suggest 
that there may be a general response set to 
assume similarity or difference when making 
predictions related to the dimension of ad- 
justment measured by the A scale, but not re- 
lated to the dimensions measured by either 
the ISB or the R scale. Maladjustment as 
measured by the A scale seems to be related 
to a tendency to believe that others are dif- 
ferent from one’s self; hence, in a study 
where the targets predicted are truly quite 
different from the Ss, spurious positive corre- 
lations between maladjustment and predictive 
accuracy could be obtained. 

The hypothesis of a negative relationship 
between adjustment and adequacy of predic- 
tive behavior is neither clearly refuted nor 
confirmed. The findings demonstrate a trend 
toward a negative relationship between ISB 
scores and over-all accuracy of prediction in 
the kind of experimental situation described 
here; this negative relationship is most ap- 
parent in the differential ability among indi- 
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viduals of different levels of adjustment to 
predict differences between self and others 
accurately. 

Generalizations of these findings are limited 
by the fact that the three measures of adjust- 
ment used, while positively correlated among 
themselves, are related to the predictive ac- 
curacy scores in different ways. Statements 
about the relationship of adjustment to pre- 
diction behavior are not meaningful apart 
from the particular criteria of adjustment em- 
ployed. Although the study as executed has 
the virtue that all Ss had rather extended 
and fairly uniform acquaintance with the tar- 
gets predicted, it must be Pointed out that 
most other studies in this area have selected 
target figures who were either S’s peers or 
who could readily be identified by S as peers. 
To the degree that Ss might be expected to 
operate with a different set of assumptions 
about figures approximately 10 years older 
than they and with Ph.D.’s in Psychology, 
the results of the Present study may not be 
comparable to those of other studies, 

Perhaps better answers in this exceedingly 
complex area could be obtained if the ques- 
tions asked were framed differently. That is 
to say, if questions were asked not in terms 
of highly abstracted variables like adjust- 
ment-maladjustment, but rather in terms of 
what aspects of adjustment or what particu- 
lar and characteristic modes of dealing with 
problems might be related to adequacy of in- 
terpersonal perceptions, Further studies could 
also profit from more Specification of what is 
predicted. One might hypothesize that given 
modes of adjustment are differentially related 
to ability to predict certain classes of be- 
havior on the part of others. For example, in- 
dividuals who have difficulty in coping with 
their own aggressive propensities might be ex- 
pected to be less accurate in predicting ag- 
gressive responses on the part of others, but 


relatively more accurate in predicting others’ 
dependent responses. 


Summary 


Fifty-two college students were asked to re- 
spond to a 40-item, forced choice question- 
naire and then to predict their respective in- 
structor’s responses to the same questionnaire. 
On a previous occasion, three paper-pencil 
measures of adjustment had been obtained for 
these Ss—the Rotter Incomplete Sentences 
Blank, and the Welsh A and R scales 
(MMPI). Scores for over-all accuracy of 
Prediction, various components of accuracy, 
and tendencies to assume similarities or dif- 
ferences between self and others in making 
predictions were correlated with the meas- 
ures of adjustment. Results obtained indicate 
a trend for adjustment as measured by the 
ISB to be negatively related to adequacy of 
prediction. Scores on the A scale were nega- 
tively related to tendency to assume simi- 
larity in making predictions, 
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Nonprojective Determinants of Perception 
on the TAT’ 


Bernard I. Murstein 


Louisiana State University 


Projective techniques are coming under ever 
closer scrutiny with regard to the meaning 
of the material elicited by these techniques. 
Since the various techniques differ in their 
stimulus properties (clay, ink blots, dolls, 
scenes of people, etc.), it would seem of im- 
portance to investigate the nonprojective de- 
terminants of perception as well as the more 
personal aspects, in order to interpret the 
content in a more meaningful manner. 

Eron in earlier studies (1, 2) showed that 
the emotional tone of the stories told to the 
TAT cards was more often negative (un- 
happy, sad, hostility, death) than positive 
(pleasant, friendly, contented). x 

It should follow, therefore, that a positive 
correlation ought to exist between the emo- 
tional tone and the positive-negative stimu- 
lus value of the cards such that negative 
scenes tend to elicit negatively toned stories. 

In addition, clinical experience with the 
TAT cards has suggested to the author that 
in those cards which are relatively unstruc- 
tured or ambiguous with regard to their 
Stimulus properties, positively-toned stories 
were often elicited. Conversely, clearly struc- 
tured or unambiguous cards often elicited 
negatively-toned stories. The last observation 
does not necessarily imply any innate relation- 
ship between structure and tone, but rather 
suggests that in their selection of cards in 
constructing their tests, Murray and Morgan 
chose many highly structured cards whose 
stimulus properties also were quite negative 
with regard to the emotions expressed. 

The following hypotheses were therefore 
formulated: 

1 Paper read at the meeting of the American Psy- 
chological Association, New York, 1957. 


1. The emotional tone of stories told in 
response to the TAT cards is positively re- 
lated to the pleasantness-unpleasantness of 
the TAT cards. Those cards pleasant in ap- 
pearance yield pleasantly toned stories. 

2. The emotional tone of stories is also a 
function of the clarity of the emotions ex- 
pressed on the TAT cards. Those cards most 
clearly structured (unambiguous) will yield 
negatively toned stories while unstructured 
cards yield more positive themes. 

3. While some overlap exists between the 
dimensions of pleasantness-unpleasantness, 
and ambiguous-unambiguous, both dimen- 
sions show sufficiently low intercorrelation to 
be considered separately as factors determin- 
ing the tone of the stories told. 


Procedure 


Twelve normal female subjects (Ss) (8 
students, 4 secretaries), ranging in age from 
18 to 39, with a median age of 25, were given, 
in a randomized fashion, the same 20 TAT 
cards that Eron (2) used in his earlier study 
with women (1, 2, 3 GF, 4, 5, 6 GF, 7 GF, 
8 GF, 9 GF, 10, 11, 12 F, 13 MF, 14, 15, 16, 
17 GF, 18 GF, 19, 20). The age range and 
median were roughly equivalent to that of 
Eron’s group. 

The emotional tone ratings quantified by 
Eron on a five-point scale ranging from 2 to 
—2 according to their pleasantness-unpleas- 
antness were totaled up for each card from 
his study, omitting rejects. These sums were 
then converted into ranks so that the most 
unpleasantly toned card was ranked 1, while 
the most pleasant card was ranked 20. 

The 20 cards were given individually by 
four different experimenters to the 12 Ss, 
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with the author administering the cards to 
six Ss, while the others administered the cards 
to two Ss each.? Essentially, the following in- 
structions were given: 


I want you to rank each card according to how 
clear the card is with regard to the emotions ex- 
pressed in it. It does not matter whether the card is 
happy, sad, bored, friendly, etc. That card in which 
the emotion expressed is most easily determined you 
will rank as 1. That card which is next clearest in 
terms of some definite emotion expressed, rank as 2, 
and so forth, until the card ranked as 20 Should be 
the one which because it is so ambiguous is capable 
of being seen as expressing many possible emotions. 


The instructions for ranking according to 
the pleasant-unpleasant dimension were: 


I want you to rank each card according to how 
unpleasant or unhappy the emotion expressed seems 
to be. That card which is the most unpleasant or un- 
happy should be ranked 1, the card next most un- 
Pleasant should be ranked 2, etc, until 20 should 
represent the card which is the least unhappy or un- 
Pleasant, or more simply, that card which is the 
most pleasant one. 


Half of the Ss received the clarity-lack-of- 
clarity task first, while the other half re- 
ceived the pleasant-unpleasant ranking first. 
Subsequent appointments were made by the 
examiners for the “second Part” of the ex- 
periment, which occurred from three days to 
three months later. The “second Part” was a 
retesting for reliability purposes. 


Results 


f The rho coefficients between the Eron emo- 
tional tone-of-story dimension from his study, 
and in this study the ambiguous-unambiguous, 
and pleasantness-unpleasantness dimensions 
of the stimulus properties of the cards are in- 
dicated for each S in Table 1. This table also 
shows the average rho intercorrelation be- 
tween these dimensions for the pooled sub- 
jects. Test-retest reliability for the 10 of the 
12 Ss available for retesting, covering an in- 
terval of from three days to three months, 
was .91 for the pleasantness dimension and 
.84 for the ambiguity dimension. The reli- 
ability was not significantly related to the 
duration of time between the first and second 

2The author expresses his thanks to Deldon Mc- 


i ichard 
Ronald Pryer, John Roitzsch, and Ricl 
Sere for their aid in administering the TAT cards. 


Bernard I. Murstein 


Table 1 


Correlations Between Pleasantness, Ambiguity, and 
Emotional Tone Dimensions for Each S 
and for Pooled Ss 


Ambiguity Pleasantness R 
vs. vs. Ambiguity 
Emotional Emotional vs. 
S Tone Tone Pleasantness 
1 58 60 69 
2 53 .29 02 
3 ae 56 —.12 
4 58 50 .60 
5 75 60 59 
6 16 -60 - «12 
7 53. .65 A7 
8 52 50 21 
9 83 A3. Ad 
10 74 75 68 
11 25 .70 .09 
12 .60 At 64 
Avg.r aoe .59* 40* 


* Significant beyond .01 level, 


administration of the cards. Individual varia- 
tion between the 12 Ss in the correlation of 
the ambiguous-unambiguous dimension with 
emotional-tone ranking is considerable (x; 
Pp < .10) though not for the pleasant-unpleas- 
ant vs. emotional-tone correlation (x2; 2 < 
80). Both of the dimensions (pleasant-un- 
pleasant, and ambiguous-unambiguous) are 
significantly related to the pooled Ss emor 
tional-tone rankings as taken from poe 
study beyond the .01 point for a one-taile 

test of significance. The respective correla- 
tions are .59, and .56. Hypotheses 1 and 2; 
therefore, are confirmed. The average correla- 
tion between the pleasantness-unpleasantnes® 
and ambiguous-unambiguous dimensions a 
significant at the .01 point with rho = - k. 
By use of the formula for correction for a 

tenuation, it may be noted that 45% of t e 
“true” variance of the emotional tone ratings 
is accounted for by the pleasantness-unpleas- 
antness vs. emotional tone-rating correlation, 
and 44% of the “true” varjance is accounted 
for by the ambiguous-unambiguous S 
tional-tone rating correlation. The “true 

common variance between pleasantness-Un- 
pleasantness and ambiguity-unambiguity 1S 
only 21%. Hence, both of these dimensions 
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must be taken into account in predicting the 
emotional tone ratings to TAT cards. There- 
fore, Hypothesis 3 is seen to be confirmed. 

Lastly, neither order of presentation of the 
dimensions nor age was found to be related 
to the size of the correlation for any di- 
mension. 


Discussion | 


It would be helpful in evaluating the find- 
ings of this study to utilize a schema of Hel- 
son’s theory of adaptation-level (3). The the- 
ory briefly stated would hold that perception 
is a resultant of the pooled interaction of the 
stimulus, background, and residual factors 
(i.e., personality). Singer (7) has stated that 
clinicians have been too prone to overweight 
the importance of personality in determining 
perception, to the neglect of stimulus and 
background factors. The results of this ex- 
periment seem to support Singer in confirm- 
ing the existence of several nonprojective de- 
terminants of perception on the TAT. The 
stimulus-determined dimensions of pleasant- 
ness and ambiguity together accounted for 
61% of the true common variance with the 
emotional tone-of-stories dimension. Presum- 
ably, within the remaining true variance the 
mechanism of projection occurs, though this 
mechanism itself has been found to be ex- 
ceedingly complex (4, 5, 6). 

The findings of this study, therefore, would 
seem to call for a bridling of the unrestrained 
assumption that, for example, perception of 
hostility on one of the TAT cards is neces- 
sarily indicative of a “hostile” personality. 
In a technique such as the TAT where the 
stimulus properties vary considerably 10 a 
biguity and pleasantness from card to card, 
the perception of hostility on one card might 
indicate considerable distortion of the stimu- 
lus properties (projection? ), while on an- 
other card reflect only considerable respect 
for the objective stimulus. 

A clinician reviewing the 
stories without noting the s 
teristics of the card that occasione 
draw, therefore, entirely inaccurate ! 
Consequently, it might be beneficial to con- 
struct a scale of cards whose pictures differed 
in pleasantness, structure, etc- by some meas- 
ured amount based on the construction © 


themes of the 
timulus charac- 
d it, might 
inferences. 
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judged group norms. In this way, clinicians 
might come closer to a realization of the sus- 
pected correlation between “deviation of per- 
ception” and deviation of personality. In 
short, “deviation of perception” must take 
cognizance of measured stimulus and back- 
ground characteristics of the TAT cards be- 
fore we attribute the remaining variance to 
deviations in personality patterns. 


Summary 


The purpose of this study was to examine 
some of the nonprojective determinants of 
perception on the TAT. 

Three hypotheses were formulated: 


1. The emotional tone of stories told in re- 
sponse to the TAT cards is positively related 
to the pleasantness-unpleasantness of these 
cards. Those cards pleasant in appearance 
yield pleasantly toned stories. 

2. The emotional tone of the stories is also 
a function of the structure of the emotional 
expression on the cards. Those cards most 
clearly structured (unambiguous) will yield 
negatively toned stories, while unstructured 
(ambiguous) cards yield more pleasant 
themes. 

3. While some overlap exists between the 
dimensions of pleasantness-unpleasantness 
and ambiguity-nonambiguity, both dimen- 
sions show sufficiently low intercorrelation to 
warrant consideration as separate factors de- 
termining the tone of the stories told. 


A tho coefficient of .56 between ambiguity- 
nonambiguity and emotional tone, and .59 
between pleasantness-unpleasantness and emo- 
tional tone (both significant at the .01 point) 
seemed to lend support to Hypotheses 1 and 2. 

Hypothesis 3 found confirmation in that 
while both of the dimensions of pleasantness- 
unpleasantness and ambiguity-nonambiguity 
correlated 7’ = 40 with each other, each had 
considerable valid variance in common with 
the emotional tone dimension which was not 
accounted for by this correlation. 
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The Validity of the Objective Rorschach 
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Because of heavy demands for their diag- 
nostic services, psychologists have attempted 
to develop valid personality tests which are 
quickly scored, easily evaluated, and adapt- 
able to testing large groups of subjects (Ss). 
A number of such rapid screening devices are 
now in use. One of the newest to be offered 
to the busy clinician is the Objective Ror- 
schach, a variation of the multiple choice 
Rorschach, developed by P. O. O'Reilly G 
3, 5). In this procedure, the S is tested indi- 
vidually and he is shown each Rorschach 
card in turn. Together with each card, he is 
Presented with a list of 12 responses and is 
asked to choose the two responses which he 
feels best describe the card. His choices are 
Scored and an over-all measure of disturbance 
is derived by adding the scores obtained on 
each card. O’Reilly’s data indicate that this 
Procedure is an effective device for distin- 
Suishing among normals, neurotics, and psy- 
Chotics (5), and that the over-all score is 
also significantly related to clinical improve- 
ment in response to therapy (6). The pur- 
Pose of the present study is to test the va- 
lidity of the Objective Rorschach when used 
with a different sample of Ss, and to com- 


Pare its ability to identify mental patients 


1 These data were gathered by the second author 
as part of a master’s thesis undertaken at the Uni- 
Versity of Detroit. The authors wish to express their 
Bratitude to the staffs of the various hospitals and 
Schools, and to the social organizations who co- 
Operated in this study by generously contributing 
their time and advice. 


with that of a more conventional test, the 
MMPI (2). 


Method 


The Ss for this study consisted of three 
groups of white males, matched closely as to 
age and education. Their age range was 17-45 
(median 26.6), and their education ranged 
from 7-17 years of school completed (median 
12.2). The first group consisted of 25 nor- 
mals who were functioning adequately in the 
community, and who denied ever having had 
any serious personality difficulties. The second 
group consisted of 25 normal Ss who were 
hospitalized with an acute physical illness, an 
injury or infection, which as far as could be 
determined was not obviously psychosomatic 
in origin. These Ss were in a stressful situa- 
tion and experiencing physical and mental 
discomfort. The third group consisted of 25 
hospitalized schizophrenics, all of whom were 
testable but, in the judgment of the staff, 
grossly disturbed in their thinking or behavior. 

Each S was tested by the same psycholo- 
gist. The test battery included the Objective 
Rorschach and the group form of the MMPI. 
The measures of disturbance used in this 
study are the total Objective Rorschach score 
and the total score obtained on the MMPI 
psychosis scale developed by Peterson (7). 
In scoring this latter scale, the S is given one 
point for each of the following psychotic signs 
appearing in his MMPI, and the number of 
points are cumulated: 
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1. T scores over 70 on four or more of the clinical 
scales 

. F greater than 65 (T score) 

. Sc greater than Pt 

. Pa or Ma greater than 70 (T score) 

- Pa or Sc or Ma greater than Hs and D and Hy 

- D greater than Hs and Hy 


Aupwn 


Peterson suggests that the presence of three 
or more of these signs indicates psychosis. The 
ability of the MMPI psychosis scale and the 
Objective Rorschach to differentiate among 
our three groups of Ss was tested by means 
of chi square. 

In analyzing the results of this study, the 

major emphasis was placed on the ability of 
these two personality tests to predict psy- 
chosis. Specifically, we were interested in 
whether or not the published cutoff scores on 
these tests succeeded in separating our schizo- 
phrenic patients from the two nonpsychotic 
groups. In evaluating the predictive efficiency 
of these tests, it should be kept in mind that 
only one-third of our sample of 75 Ss con- 
sists of psychotics. Therefore, if one were to 
arbitrarily diagnose each S as not being psy- 
chotic, two-thirds of the diagnoses would be 
correct. For a test to be of value in this situa- 
tion, its use would have to allow accurate 
diagnosis of more than the 50 Ss who could 
be correctly diagnosed without knowledge of 
their test results. In addition to the statisti- 
cal questions of whether or not the three 
groups obtained significantly different (me- 
dian) scores on these two tests and whether 
or not using these tests leads to more correct 
diagnoses than can be obtained without the 
tests, one must take into consideration the 
practical problem of whether the additional 
number of correct diagnoses one might ob- 
tain justifies the time and trouble it takes to 
administer a given test. 


Results 


Objective Rorschach 


Table 1 shows the distribution of Objec- 
tive Rorschach scores obtained by our three 
groups. In his original article, O'Reilly (5) 
recommends using a cutoff score of 38 and 
above as an index of psychosis. Although the 
use of this cutting point leads to the correct 
classification of 73% of our Ss, examination 
of Table 1 will show that only five of our 75 


William D. Winter and Ramon A. Salcines 


Ss obtained scores above 37. Although these 
five were all in the schizophrenic group, 80% 
of the schizophrenics fall below this cutting 
point, which would thus appear to be set too 
high to be of practical value for our sample. 
A median test showed that our schizophrenic 
Ss scored significantly lower on this test than 
did O’Reilly’s psychotic Ss (x? = 18.0, 1 df, 
p < .001). Since O'Reilly does not describe 
the composition of his sample, we can offer 
no hypotheses as to why this large difference 
occurred. Although a higher percentage of 
correct diagnoses was made by using the test 
than could be made without it, this increase 
is insignificant, and the meager results ob- 
tained scarcely justify the effort involved in 
individually testing 75 Ss. 

Further examination of Table 1 will show 
that a cutoff score of 36 and above, which 
also correctly classifies 73% of our Ss, is also 
of little practical value, since the addition of 
five correct diagnoses over the 50 obtainable 
without using the test is not a significant in- 
crease. The use of this cutoff results in the 
correct diagnosis of only nine psychotics, at 
the expense of incorrectly labelling four non- 


Table 1 


Distribution of Objective Rorschach Scores 


Physically 


Normal ill Psychotic 
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The Objective Rorschach and the MMPI 


Table 2 


Ss Falling Above and Below the Objective 
Rorschach Common Median 
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Table 3 


Ss Obtaining Scores of Three or Above on 
MMPI Psychosis Scale 


sS Physically Physically 

core Normal ill Psychotic Score Normal ill Psychotic 
32-49 8 11 18 3-6 3 5 19 
25-31 17 14 7 0-2 22 20 6 


X= 8.4; df = 2; p < 02. 


Psychotics as being psychotic. Since the two 
Cutting scores discussed above result in the 
highest percentage of correctly classified Ss, 
and since neither proves to be satisfactory, 
We must conclude that the O’Reilly Objective 
1 orschach is valueless for the practical prob- 
em of making individual diagnoses of psy- 
Chosis in our Ss. 

To determine whether the Objective Ror- 
Schach differentiated our three groups, an ex- 
tension of the median test was performed (8). 
i able 2 shows the number of Ss in each group 
alling above and below the common median 
of the entire sample of 75. In this case, the 
— score is 32 and above, and chi square 
ru this contingency table is 8.4, which for 
rig degrees of freedom is significant beyond 

e .02 level, Therefore, we can reject the hy- 
Pothesis that our three groups come from the 
Same population or from populations with 
equal medians. The Objective Rorschach does 

ave some measure of validity in that the 
Median scores of the three groups differ from 
ne another, although the relationship Þe- 
Hebe test scores and diagnostic category 1$ 
a high enough to justify the use of this test 
F making individual predictions of ea 
oF sample such as ours, in which one-thir' 
i he Ss are psychotic. Whether the forecast- 
ng efficiency of this test can be greatly im- 
Proved by item analysis must await further 
study, 


Mupr Psychosis Scale 


5 AE results (7) suggest tha 
S ree and above on his scale i 
Tvative yet effective indicator of P 
Table 3 shows the number of Ss in each 
far who obtained scores above and below 
is cutting point. By using this cutoff, 81% 


t a score 
s a con- 
sychosis. 


x? = 26.4; df = 2; p < .001. 


of our Ss are correctly classified as to whether 
or not they are psychotic. This represents a 
significant increase (22%) of 11 correct diag- 
noses over the 50 that could be correctly de- 
termined without the test. 

As with the Objective Rorschach, a median 
test was performed to see whether the me- 
dians of the three groups differ. Table 4 pre- 
sents the number of Ss in each group who 
scored at or above the common median (two 
and above) of the entire sample. The chi 
square for this table is 18.2 ( < .001). 
Therefore, Peterson’s psychosis scale on the 
group-administered MMPI is more effective 
than the individually administered Objective 
Rorschach in differentiating our three groups 
and in making individual diagnoses of psy- 
chosis. However, since a one-point difference 
in the cutoff score on the Peterson scale makes 
a distinct difference in the number of correct 
diagnoses, one might well question the va- 
lidity of judgments made on the basis of such 
a short instrument, especially when a given 
clinical patient obtains a score at or near the 
cutting point. It should also be noted that 
both the Peterson scale and the Objective 
Rorschach drew the majority of their “false 

ositives” from the group of nonpsychotic, 


physically ill Ss. 


Table’4 


Ss Falling Above and Below the MMPI 
Psychosis Scale Common Median 


Physically 
Score Normal ill Psychotic 
2-6 6 14 21 
0-1 19 11 4 


x? = 18.2; df = 2; p < 001. 
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Table 5 


Correlations Between Objective Rorschach 
Score and MMPI Scales 


MMPI scale r 

K —.09 
P 37t 
Hs + .5K 22 
D -40** 
Hy 258 
På + 4K .29* 
Mf —.04 
Pa .30** 
Pi+ 1K 37** 
Sc+1K .41** 
Ma + .2K 33** 


Psychosis scale 


* pi <.05, 
a AA 


In Table 5 are listed the product-moment 
correlations between the Objective Rorschach 
total score and each of the MMPI scales for 
our entire sample of 75. There are several 
low, but significant correlations Present, espe- 
cially between the Objective Rorschach and 
those MMPI scales indicative of psychosis. 
The two tests are to some extent measuring 
the same things, but for the Purposes investi- 
gated by this study, the MMPI psychosis 
scale seems to be a more effective instrument 
than the Objective Rorschac! 


Summary and Conclusions 

A sample of 25 normal, 25 physically ill, 
and 25 schizophrenic white male subjects was 
tested with the O'Reilly Objective Rorschach 
and the group form of the MMPI. The basic 
problem investigated is whether the Objective 
Rorschach or the MMPI psychosis scale de- 
veloped by Peterson is more effective in dif- 
ferentiating the psychotic Ss from the other 
two groups. Our results indicate that although 
the three groups obtained significantly differ- 
ent medians on the Objective Rorschach, and 
although this test showed significant correla- 
tions with several of the MMPI scales, never- 
theless the Peterson MMPI psychosis scale 
was much more effective in making individual 
ictions about whether or not a given S 
psychotic. The Objective Rorschach was 
1 value for this purpose. For our 
MMPI psychosis scale was a 


pred 
was ) 
of no practica 
sample, the 
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more valid measure of psychotic disturbance. 
The MMPI cutoff score suggested by Peter- 
son’s results was applicable to our Ss, but the 
Objective Rorschach cutoff score suggested by 
O'Reilly was too high to be useful, since our 
psychotic Ss as a group scored significantly 
lower on this test than did O’Reilly’s psy- 
chotic sample. Both tests drew most of their 
“false positives” from the group of physically 
ill patients. This suggested that a clinician 
should evaluate the stresses found in a per- 
son’s life situation before attempting to make 
a diagnosis of psychosis on the basis of a 
score on either test. 

Although the Objective Rorschach is an in- 
teresting and potentially useful screening de- 
vice, in its present stage of development it 
does not appear to offer any advantage over 
the more commonly used and more easily ad- 
ministered and scored MMPI, at least for the 
purpose investigated in this present study. 
Further research is needed to cross-validate 
our findings and to ascertain why our psy- 
chotics differed from O’Reilly’s sample. It 
would also be important to determine if the 
Objective Rorschach. is of‘ greater predictive 
value than tests like the MMPI in such areas 
as therapeutic improvement (6). 
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Influences on MMPI Profile Peak 


Distributions in an Abnormal Population 


Bernard S. Aaronson 
New Castle State Hospital, New Castle, Indiana 


Sex and age are factors which may have 
differential influence in bringing people into 
Membership in a population of abnormals. In 
the case of sex, differences in morphology and 
Physiology, as well as differences in life ex- 
Periences, may all contribute to differing per- 
sonality characteristics which cause males and 
females to be classified as abnormal. In the 
a of age, different personality factors may 

elp create difficulty for individuals at vari- 
ous stages of the life process. To some extent, 
Such differences may be a function of the de- 
mands made upon the individual by our cul- 
ture as he moves through life. To some ex 
tent, particularly among early entrants into 
abnormal populations, the personality factors 
themselves may be so maladaptive as to cre- 
ate difficulty regardless of any demands made. 

The present study is an attempt to evaluate 
some of these factors as they affect the inci- 

ence of highest points on Minnesota Multi- 
Phasic Personality Inventory profiles. Knowl- 
dge of the influence of age and sex on these 
ima butions should also help in understand- 

Ng the significance of given MMPI profile 
Patterns, 


Procedure 


U All of the cases in An Atlas for the Clinical 
all of the MMPI (4) were considered, and 

Bees without codable high point or wit 
elin suspicion of invalidity in the profile were 
ho mated (profile code followed by X)- Only 
wa first profile code obtained in each case 
‘i S considered, regardless of how many p'o- 
he or how many admissions were recorded. 
wen selection yielded 871 cases of whom 416 
ion, males and 455 females. The sex distribu- 
n was then compared with the original sex 


distribution of 458 males and 510 females in 
the Atlas sample by chi square, and a chi 
square of 0.23 was obtained between them, 
which suggests that they are not significantly 
different. 

The profile codes were divided according 
to which scale was highest in the profile, and 
the proportion of the sample accounted for by 
each such peak was determined. The cases 
were further divided by age in decades, and 
the proportion of cases falling in each decade 
was determined. Because of the small num- 
ber of cases 60 years old or older, they were 
combined with the group which fell between 
50 and 60 years of age. The expected inci- 
dences of profile peaks at given age levels and 
for males and females were calculated and 
compared with the actual incidences by chi 
square. The interactions between sex, age, and 
profile peak incidence were determined, and 
further analyses were made to determine at 
which ages significant relationships occurred 
and on which scales they took place. Indi- 
vidual incidences were examined to determine 
the nature and extent of the relationships 


with age and sex. 


Results 


The division of the Atlas sample by profile 
peaks is summarized in Table 1. D seems to 
be the scale on which peaking occurs most 
frequently. This observation is in accord with 
Meehl’s (6) that D is the most frequent peak 
among abnormals. 

Table 2 shows the division of the sample 
by age. By far the greatest proportion of the 
sample come into a population of abnormals 
during the third and fourth decades, after 
which there seems to be a consistent decline. 
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Table 1 


Incidence of Individuals with Various Profile 
Peaks in the Atlas Sample 


Profile peak Frequency Proportion 
Hs 77 .09 
D 245 .28 
Hy 93 al 
Pd 160 18 
Pa 54 .06 
Pt 72 08 
Sc 86 -10 
Ma 84 10 


Although it is not shown in the table, only 
2% of the total sample were 60 or older, and 
most of these were very close to 60. 

When the interaction of sex and profile 
peak incidence is tested by chi square, a 
value of 39.99 is obtained (p < .001). Table 3 
shows that profiles with Hs as the highest 
point tend to be obtained by men (p < .05). 
Profiles with Pt as the highest point also tend 
to be obtained by men (p < .02). Profiles 
with Hy as the highest point tend to be ob- 
tained by women (p < .001). A trend also 
seems present for women to obtained profiles 
in which Pa is highest, but it does not attain 
significance, 

_ Comparison of the obtained sex distribu- 
tions for each profile peak shown in Table 3 
with one another by chi square yields much 
the same results. Significantly more men seem 
to obtain profiles with Hs as the highest point 
than obtain profiles with D, Hy, or Pa. These 
differences are significant at beyond the .05, 
.001, and .01 levels, respectively. More men 
obtain profiles with Pt as the highest point 
than obtain profiles with Hy or Pa. These 


Table 2 


Incidence of Individuals of Various Age Levels 
in the Atlas Sample 


Age level Frequency Proportion 
10-19 135 16 
20-29 253 .29 
30-39 244 .28 
40-49 140 16 
50-75 99 At 
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differences are significant at the .001 and .01 
levels, respectively. Significantly more women 
obtained profiles with Hy as the highest point 
(p < .001) than obtain profiles with any 
other scale except Pa as their peak. More 
women obtain profiles with peaks on Pa than 
obtain profiles with peaks on Hs, Pt, Sc, and 
Ma. The first three comparisons are signifi- 
cant at the .01 level, the comparison with Ma 
is significant at the .05 level. 

When the interaction between age and inci- 
dence of profile peaks is tested, a chi square 
of 102.71 is obtained, which is significant at 
the .001 level. The data in Table 4 suggest 
that significant age relationships occur with 
Hs, D, Pd, and Sc. The relationship between 
Hs and age is significant at the .01 level; the 
latter three are significant at the .001 level. 
Significant relationships between profile peaks 
and age are noted at every period studied, 
except that between 30 and 39. 

Inspection of the expected and obtained in- 
cidences of profile peaks at the various age 
levels as shown in Table 4 suggests that Hs 
and D peaks are comparatively uncommon in 
early life but become much more common as 
the individuals entering the clinical popula- 
tion become older. The reverse seems to be 
true of Pd and Sc. In addition, Pt peaks seem 
to be more prominent in the group which 
enters into an abnormal population in the 
twenties. 


Table 3 


A Comparison by Chi Square of Expected and Obtained 
Distributions of Men and Women Obtaining 
Given Highest Points on the 
MMPI Profile 


Expected V Obtained N i 
Chi 
Scale M F M F square 
Hs 37 40 47 30 5.20° 
D 115 130 114 131 ov. 
Hy 44 49 a1 2 225 
Pa 75. g 82 78 1m 
Pa 25 29 19 35 AA 
Pi 34 38 4 28 aa 
Sc 40 46 4 «42 We 
Ma 39 45 45 39 i 


a p is at least .05. 
b p is at least .02. 
e $ is at least .001. 


$ 


T7 
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Age and Sex in MMPI Profile Distributions 
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Table 4 


Expected an 


d Obtained Incidences of MMPI Profile Peaks in Successive Decades 


Age range 
10-19 20-29 30-39 40-49 50-59 

Peak 

scale E o E (0 E oO E (0) E (0) 
Hs 12 Z 5 23 13 2 29 12 1% o n 
D 39 158 71 60 6s 75 39 51° 27 a 
Hy 16 12 28 2 23 27 26 16 22 10 10 
Pd 25 468 45 57 4 37 235 1e 7 
Pa 3 7 15 14 15 2 8 6 6 35 
Pi Ww å 7 2 3 19 18 u 8 s 5 
Sc 14 27° 235 28 4 17 14: 38 10 6 
Ma 1416 25 30 24 20 4 4 10 10 


$ Difference is significant at the .05 level. 

z Dienes is significant at the .02 level. 

a Di erence ignificant at the .01 level. 
ifference is significant at the ‚001 level. 


Discussion 


_The close association between Hy as the 
highest point and being female suggests the 
early theories of hysteria as a feminine com- 
Plaint (2, p. 370). The association of peaks 
on Sc with youth suggests the Kraepelinian 
formulation of dementia praecox aS 4 disorder 
of the young (9, p. 21). The latter is also in 
accord with the association of the diagnosis 
of schizophrenia with youth among patients 
admitted to mental hospitals (7)- A 
_ When the description of the scales as given 
ìn the manual (3) for this test is taken into 
account, men seem to predominate among 
those with vague physical complaints which 

© not seem to be obviously successful in 
Betting them out of unacceptable situations. 

hey also seem to include a greater number 
Of individuals with obsessive-compulsive com- 


Tainig, phobias, and excessive worry 4m 
oubt, Women seem to predominate among 
complaints 


individuals with specific somatic 
age may be alleviated easily but return un- 
der stress. They seem to show more pathology 


in the area of interpersonal relationships: ; 
me 


Should be noted that the scales 07 whic 
Peak are among the scales which Welsh (8) 
Uses to suggest internalization, while Hy, on 
Which women particularly tend to predomi- 
hate, is among the scales used py him to sug” 
gest externalization. The data suggest that 


Men may be given to internalization of their 


problems while women may tend to external- 
ize them. . 

With regard to age, the scale description in 
the manual suggests that younger individuals 
coming into an abnormal population may be 
characterized by difficulty in their relations 
with the environment as typified by acting 
out against it or withdrawing from it. Older 
persons seem to have more problems with 
their own physical and mental functioning. 
In this connection, it is of interest to note 
that Hs and D, which are common in the 
older age group, are among the scales re- 
garded by Welsh (8) as suggestive of inter- 
nalization of problems, while Pd, which oc- 
curs among the young, is one of the scales 
used by him to suggest externalization. The 
significantly greater proportion of individuals 
with peaks on Pé is in accord with a previous 
finding by Brozek (1) that younger males 
tend to admit to more obsessive-compulsive 
symptoms than older males. Brozek, however, 
did not find significant differences on the Hs 
scale. It should be noted that Brozek was 
comparing absolute scale magnitudes, while 
this study deals with the relative position of 
the scale in the profile. Lauber and Dahl- 
strom (5) have pointed out that the utiliza- 
tion of absolute scale scores may obscure re- 
lationships which the utilization of profile 
codes may reveal. 

When the data on age and sex are consid- 
ered together, Hs and Pt which occur among 
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males also seem to show a relation with age. 
Since the scales on which women peak show 
no such relationship, this might suggest that 
men tend to enter into clinical populations in 
the twenties and forties, while women show 
no tendency to enter at any particular age. 


Summary 


An analysis of the distribution of the pro- 
file peaks of 871 cases taken from An Atlas 
for the Clinical Use of the MMPI with re- 
gard to the sex and age distributions of the 
sample suggests that men tend to obtain peaks 
on Hs and Pt and women on Hy and Pa, 
Peaks on Pd and Sc seem characteristic of a 
younger age group and peaks on Hs and D of 
an older. Some possible implications of this 
are noted. The scales on which women peak 
tend to imply a more social orientation than 
those on which men peak. Younger entrants 
into an abnormal population seem character- 
ized by behavior patterns maladaptive to so- 
cietal demands. Older entrants seem charac- 
terized by problems centering around their 
own physical and mental functioning. 
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Spearman Correlations Between MMPI Scotes 
of College Students and Their Parents’ 


Andrew L. Sopchak* 


Memorial Center for Cancer and Allied Diseases, New York, New York 


The purpose of this study was to determine 
the relation between MMPI scores for college 
students and their parents. As part of their 
laboratory work in elementary psychology, 
Students at the University of Maine were 
given the booklet form of the MMPI. The 
Parent(s) of 25 male students and 25 female 
students volunteered to take the MMPI. 

The tests were scored according to standard 
Procedure and tests whose validity scores on 
?, L, and F were high, were discarded. The 
tank correlations are based on raw scores on 
the MMPI for students and their parents. 

The mean age for the 50 students was 19.9 
years. The 41 mothers had a mean age of 47.7 
Years, and the 35 fathers had a mean age of 
50.5 years, 

The mothers’ education ranged from high 
school graduates to normal school training Or 
College graduates. Some of the fathers had 
only an eighth-grade education, while others 
Were college graduates, holders of master’s 
degrees, or were dental and medical school 
Staduates. The mothers were mostly house- 
Wives, The father were painters, lobster men, 
Managers, engineers, dentists, and physicians. 


Results 


Tables 1 and 2 present the ranges, means, 
and standard deviations on the MMPI scales 
for the students and their parents. The scores 
Of the students are similar to scores 
by other investigators (1, 2, 5, 6, 7; 
Other subjects. Although the present samples 


ahis study was supported in part 
rant M-884(C) from the National 
Eora Health, National Institutes of 
: lic Health Service. ; 
Formerly at the University of Maine 
ata were obtained. 


by Research 
Institute 0 
Health, 


where these 


are relatively small, the mean scores are about 
the same as those obtained by Sopchak (7) 
on a much larger sample from the same geo- 
graphical area. 

In comparison to Schmidt’s (5) adult men, 
both of the groups of fathers are considerably 
different. However, Schmidt’s subjects were 
mental hospital patients. They are also differ- 
ent from the original standardization group of 
McKinley and Hathaway (3). In comparison 
to Verniaud’s (8) adult women, both groups 
of women are similar to hers except on the 
“neurotic triad” scales on which our women 
are considerably higher. The means for the 
fathers and mothers are very similar. The 
mean scores of the fathers and mothers are 
more nearly alike than are the scores of the 
subjects with their parents. 

Table 3 presents the Spearman correlations 
between the scores for the subjects and the 
scores for their parents. 

More significant correlations were obtained 
between the scores of males and fathers than 
between those of males and mothers. On the 
other hand, many more significant correla- 
tions between the scores of females and their 
mothers than between females and their fa- 
thers were obtained. It appears that males 
“identify” with their fathers more than with 
their mothers, while females “identify” much 
more with their mothers than with their 
fathers. 

Five significant correlations were obtained 
between the males and their fathers, but only 
three between the females and their fathers. 
Only three significant correlations were ob- 
tained between the males and their moth- 
ers, but nine between the females and their 


mothers. 
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Table 1 
Ranges, Means, and Standard Deviations in “Score Units for 25 Males and Their Parents 
Group Hs D Hy Pd* Mf Pa Pie Sce Mat 
Men (25) Range 42-88 33-80 43-80 29-79 12-82 33-67 9-93 44-101 38-73 
Mean 52.7 53.4 56.0 53.9 60.0 51.5 56.7 57.6 58.4 
SD 8.5 10.7 8.9 10.4 14.6 9t 15.8 12.0 8.8 
% above 70 4 8 4 8 24 0 8 16 16 
Fathers (20) Range 36-86 34-89 44-80 29-69 41-65 41-65 36-72 32-73 35-65 
Mean 56.9 55.6 56.5 52.0 54.1 Sza 53.0 50.2 50.5 
SD 12.6 11.4 9.9 9.6 8.9 8.9 10.0 10.9 9.9 
% above 70 15 5 10 0 0 0 5 5 5 
Mothers (21) Range 38-82 44-78 42-72 32-76 28-95 35-62 23-73 38-69 27-65 
Mean 56.3 59.5 570 523 51.8 510 51.5 50.4 44.9 
SD 9.8 8.1 87 115 19.4 TS 12.9 9.0 10.5 
% above 70 9 9 9 9 19 0 9 0 0 
* Corrected with the K factor. 
Table 2 
Ranges, Means, and Standard Deviations in ¢-Score Units for 25 Females and Their Parents 
Group Hs D Hy Pd* Mf Pa Pls Sos Ma* 
Women (25) Range 42-63 32-69 42-64 30-79 32-82 35-65 22-69 40-95 30-78 
Mean 49.6 47.8 55.6 54.0 52.0 54.1 Bly 57.1 56.0 
SD 63 90 53 100 109 74 109 120 104 
% above 70 0 0 0 8 4 0 0 12 12 
Fathers (18) Range 43-60 36-70 45-71 39-81 45-78 42-70 30-79 41-65 26-78 
Mean 52.3 53.8 56.5 54.7 57.0 53.5 52.6 54.3 51.0 
SD 66 10.3 73 147 8.7 8.3 9.8 91 144 
% above 70 6 6 6 17 17 11 11 6 11 
Mothers (25) Range 39-77 36-77 38-73 36-69 28-87 38-68 32-73 41-76 33-65 
Mean 51.5 55.0 57.0 53.6 48.7 528 ` 510 51.9 50.0 
SD 75 11.0 7.0 7.2 124 TE 122 8.7 8.0 
% above 70 4 16 4 0 8 0 4 4 0 
a Corrected with the K factor, 
Table 3 
Spearman Correlations Between Scores for Students and Scores for Their Parents on the MMPI 
Groups compared N Hs D Hy Pa mf Pa Sc Pt Ma 
20 -19 —.09 —3g* 41* * + 47+ 04 
Males and fathers = 18.42 37* 
Males and mothers 21 05 —.20 06 i8 as “age “age 60% 2 
ao Sa 20 a s a 65** 24 
nd fathers 18 z AT 26 
ae and mothers 25 75 64 65t ogee "Soue "gyes 73.73% 50% 
16 5O MO Soe a 
hers and mothers of males = k F k Sa 
E and mothers of females 18 -09 OL -20 28 38 06: —.08 sié 


* Significant at .05 level. 
*k Sant at .01 level. 
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There are more significant correlations be- 
tween the subjects and both parents on the 
psychotic triad” scales than on the “neurotic 
triad” scales. However, scores on all three 

neurotic triad” scales are significant for the 

females and their mothers. A most impressive 
finding is the obtaining of correlations signifi- 
cant at the .01 level on each scale of the 
MMPI between the females and their moth- 
ers. An explanation for this phenomenon is 
not offered presently. 

Five significant correlations were obtained 
between the fathers and mothers of males, but 
none between the fathers and mothers of fe- 
males. The significant correlations were on 
the “neurotic” and “psychotic triad” scales. 
Why the parents of males are different from 
the parents of females is difficult to explain. 
This observation should provide a lead for 
future studies. 

According to Sakoda et al. (4), out of 54 
calculated statistics it is possible to obtain 6 
Significant at the .05 level and 3 significant 
at the .01 level by chance. Fourteen correla- 
tions significant at the .05 level and 11 sig- 
nificant at the .01 level were obtained. Al- 
Most three times as many significant correla- 
tions were obtained as could have resulted by 
chance, It is, therefore, very unlikely that the 
Significant correlations obtained are due to 
Chance factors alone. 


Summary and Conclusions 


Over a period of four years, the group form 
of the MMPI had been administered to many 
Students in elementary psychology. The par- 
ents of 25 men and 25 women volunteered to 
take the MMPI. This study reports 0? the re- 
lationship between the MMPI scores for these 
Students and their parents. 

_The results permit the following conclu- 
Sions: 


1. The subjects and their paren 
map” according to the criteria of 
Of the test. 

2. The scores of the fathers and mothers 
are different from the scores of men and 
Women in the original standardization group. 

3. The scores for fathers and mothers are 
More similar to each other than they are to 

© scores of the subjects. 

4. It appears that the fathers of WO 


ts are “nor- 
the authors 


men are 


more variable than the fathers of men. The 
mothers of men are more variable than the 
mothers of women. This is an interesting and 
challenging observation which deserves fur- 
ther investigation. 

5. There are more significant correlations 
between scores of males and fathers and scores 
of females and mothers than between scores 
of males and mothers and females and fathers. 

6. Significant correlations on the “psychotic 
triad” scales were obtained between the male 
and female subjects and both parents. 

7. On the “neurotic triad” scales, the larg- 
est number of significant correlations was be- 
tween females and their mothers. 

g. Correlations significant at the .01 level 
were obtained for each of the nine MMPI 
scales between the scores of females and their 
mothers. No explanation for this unusual find- 
ing was offered. 

9. Scores for fathers and mothers of males 
correlated significantly on five MMPI scales. 

10. Scores for fathers and mothers of fe- 
males did not correlate significantly on any 
of the scales. The reason for the discrepancy 
in correlations between parents of males and 
parents of females remains unexplained. 


Received June 17, 1957. 
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The MMPI in Cerebral Palsy 
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University of Illinois 


The problem of whether there are person- 
ality characteristics associated with the vari- 
ous disabilities, physical and psychosomatic, 
has been the object of considerable attention 
(1). Among others, there has been discussion 
of the ulcer personality, the tuberculosis per- 
sonality, and the multiple sclerotic person- 
ality. The present study approaches the study 
of the personality of individuals with cerebral 
palsy, through use of the Minnesota Multi- 
phasic Personality Inventory. It is the opin- 
ion of the authors that personality types as- 
sociated with specific disabilities do not exist. 
Harrower and Herrmann (5), reviewing stud- 
ies of multiple sclerotic patients concluded 
that there is no evidence of a multiple sclero- 
sis personality. There have been no adequate 
objective studies of those with cerebral palsy.” 


Sample 


It is estimated that there are 550,000 cere- 
bral palsied People in the United States, about 
half of them unable to work because of the 
severity of the disability. It was felt that if 
a cerebral palsy Personality existed, it would 
manifest itself in those most severely dis- 
abled. The sampling of handicapped or dis- 
abled persons, even though they are numer- 
ous, is exceedingly difficult. Usually, intact 
groups or selected individuals are most con- 
veniently available. The present sample is not 
a random sample, but it is felt to be rather 
representative of adult, severely disabled, 


1From the MA thesis of the senior author, done 
under the direction of the junior author. i i 

2 For a review of studies of the personality a the 
cerebral palsied, see the senior author’s ge. hens 

itled “Personality elements of thirty-t ree adults 
Ste rebral palsy as measured on the Minnesota 
San shasíc Personality Inventory,” on file in the 
Dniversity of Illinois library. 


cerebral palsied individuals, without mental 
or intellectual impairment, in the midwest. 
The sample includes 14 males and 19 fe- 
males, ranging in age from 20 to 43 years, 
with a mean and median age of 24. Twenty 
had a speech defect; nine were confined to 
wheel chairs all the time and three part of the 
time; three used crutches, and the remaining 
seventeen were ambulatory. Only three had 
full use of both hands, the remainder having 
at least some use, however. The range in edu- 
cation was from four to sixteen years, the 
mean being 11.4 and median 12 years. Twelve 
had been educated in the public schools en- 
tirely, the remainder in orthopedic or a com- 
bination of public and orthopedic schools ex- 
cept for three who had home instruction. 
The socioeconomic background of the sub- 
jects, as indicated by the occupations of the 
parents, was wide, ranging from unskilled la- 
bor to engineer, though apparently concen- 
trating in the middle occupational levels. 


Results 


Males and females were not significantly 
different, except for the Pt scale where the 
difference was Significant at the .05 level.* 
The sexes were pooled for further comparisons 
with other &roups containing both sexes. 

Table 1 contains the means and standard 
deviations for the present sample, together 
with the results of statistical comparisons 
with (a) the MMPI norm group, (b) Can- 
ter’s (3) multiple sclerosis group, and_(¢) 
Shontz’ (7) multiple sclerosis group. Com- 


8 All comparisons were preceded by an F test for 
homeogeneity of variances. Where variances were sig- 
nificantly different, the Cochran-Cox test of the E 
nificance of differences between means was applie $ 
An asterisk indicates instances in which this test, 
rather than the usual ¢ test, was applied. 
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Table 1 


Means and Stand 


ard Deviations on MMPI Scales for 33 Cerebral Palsied Adults, 


and Statistical Results of Comparisons with Other Groups 


Comparison with Comparison with Comparison with 
manual norms Canter’s MS Schontz’ MS 
N = 800 N = 33 N=16 
33 CPs 
Scale Mean t $ t p t $ 
? 32.00 
L 51.00 
F 49.00 
K 51.80 
Hs 55.55 4.14* 01 9.90* 01 12.65* 01 
D 52.27 145 >05 10.05* 01 4.24* 01 
Hy 56.48 4.44 01 8.40 01 3.53 01 
Pd 54.36 2.45 02 1.80 >.05 52 >.05 
Mf 54.67 2.39 .02 B3 0S ote) SN 
Pa 55.27 3.23 01 OL 5.05 83 >.05 
Pt 56.36 3.48 01 2.01* >.05 ‘Sim 05. 
Sc 63.36 8.25 01 08* >05 is  >.05 
Ma 60.76 4.11 01 2.19 >05 1.55 >.05 


* 
Cochran-Cox test used. Others are £ tests. 


Parisons with the latter two groups were 
Made by reconstructing variances from SDs 
given in the publication by Canter and the 
extended report by Shontz. 


Discussion 
andardization 


The comparisons with the st 
i ple of CPs 


Sample indicate that the sam 
Studied was significantly higher on all but 
the D scale. The actual differences are rela- 
tively small, however, except on the Sc and 
@ scales, where they reach 10 or more T- 
Score points, Before ascribing importance to 
ese results, however, two considerations are 
Suggested. First, the scores of the CPs do not 
iffer much, if any, from score 
College students (2, 4, 8), except OP the Se 
Scale. It might be an interesting hypothesis 
Worthy of exploration that college students 
and the handicapped, perhaps for differing 
Teasons (in the one case superior intelligence 
and in the other the disability) have some- 
ing in common contributing to some gen 
eral elevation on the MMPI scales, whether 
oi be a higher sensitivity or insight, or some 
er factor. 

iy an analysis of the 
seat een items contributing s50. 
le was made for 24 subjects ( 


S reported on 


answers tO the 
Jely to the Sc 
Ss) for whom 


MMPI answer sheets were available. 
Seventeen answered the item: “I have never 
been paralyzed or had any unusual weakness 
of any of the muscles” in an abnormal man- 
ner. Nine responded to the item: “Sometimes 
my voice leaves me or changes even though 
I have no cold” abnormally; eight responded 
to the item: “I refuse to play some games be- 
cause I am not good at them” abnormally. 
This suggests that these, and other handi- 
capped or disabled Ss, raise their scores on 
the MMPI because of responses that are clas- 
sified as abnormal but are in fact true for 
them. On the other hand, the disabled may, 
again because of factors related to their dis- 
abilities possibly, manifest evidences of actual 
social maladjustment or withdrawal. Ten Ss 
responded to the item: “The things that some 
of my family have done have frightened me” 
abnormally; and seven responded to the item: 
“I have never been in love with anyone” in 
the deviant manner. On the other hand, only 
three felt that they did not make friends 
about as quickly as others do. 

The comparisons with the multiple sclero- 
tic samples suggest that the CPs are better 
adjusted, or less neurotic, than the MSs. It 
might well be expected that the CP, whose 
disability is congenital, may be better ad- 


the 
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justed to his disability than the multiple 
sclerotic, whose disability has had a relatively 
recent onset, and is unpredictable in progres- 
sion, leading to the possible development of 
neurotic concern and anxiety (5, p. 10). 
Shontz (7) found that his MS Ss were sig- 
nificantly higher on Hs and Hy than a chronic 
illness group. 

While there are thus statistically significant 
differences between the CPs in this study and 
the MMPI norm group, and in other studies 
between Ss with other physical handicaps or 
disabilities and the test norms, the conclusion 
that there are specific personality types or 
patterns associated with particular disabili- 
ties does not appear to be warranted. Scores 
on tests which, like the MMPI and other 
questionnaire tests of personality, include 
many items related to physical or psycho- 
somatic conditions are probably elevated by 
reason of the actual presence of physical de- 
fects or complaints. Furthermore, it appears 
that there is, as yet at least, no evidence of 
unique personality patterns or types associ- 
ated with differing disabilities. It js suggested 
that, apart from elevations due to the actual 
presence of physical defects or disabilities, 
there may be a common tendency toward per- 
sonal-social maladjustment among all handi- 
capped individuals. It is generally agreed that 
a disability can lead to adjustment problems. 
The disability may be a source of anxiety 
and/or a tendency toward withdrawal from 
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social contacts. To some extent, both of these 
are normal in the handicapped. Whether the 
deviation is greater than can be expected is 
a question which probably should not be an- 
swered by comparing the handicapped indi- 
vidual with the norms for a nonhandicapped 
group. 


Received July 12, 1957. 
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An Evaluation of the Compatability and Reliabilities 
of Two Behavior Rating Scales for Mental Patients’ 


Donald W. Stilson; Donald J. Mason, Malcolm D. Gynther, 
and Boris Gertz 


South Carolina State Hospit 


A problem frequently encountered in men- 
tal health research is that of accurately and 
economically evaluating the level of adjust- 
ment of hospitalized mental patients ( 1). Two 
commonly used criteria of adjustment are 
discharge rates and transfer to “improved” 
wards, These criteria suffer from several in- 
adequacies which limit their usefulness. For 
example, these measures (@) usually are de- 
Pendent upon clinical (subjective) impres- 
Sions, (b) are often influenced by interest 
and/or pressure from relatives, (c) depend 
Upon available facilities, (4) are frequently 
Conceived as being therapeutic interventions 
themselves, (f) are seldom repeatable on the 
Same patients, (g) are not applicable to cer- 
tain classes of mental patients (e-8- security 
Problems, the aged, the physically infirm), 
(%) are not consistently used from one hos- 
Pital to another, and (i) may be related to 
Changes in administrative policies. ' 
Peg instruments which have been designed 
ea Provide a convenient method for evaluat- 
pE patient adjustment are the Multidimen- 
lonal Rating Scale for Psychiatric Patients 
(2) and the Hospital Adjustment Scale (3)- 

ereafter, these scales will be designated as 
the MRSPP and the HAS, respectively. Thes? 
struments are scored on the pasis of com- 
Paratively brief patient observation periods 


a authors wish to express their gratitude F 

uth» Bradley, Director of Nursing Education ae 

Contri Carolina State Hospital, for her nume: : 
ucs: to te eeakin oi Oe Te oe 

teat are also extended to Ruth A. Gynther, * 

in y A. Martin, Jr., and Charles Presher who al 
2Now patients and assembling data- 

ow at the University of Colorado. 


al and the University of South Carolina 


and are relatively free of the inadequacies de- 
scribed above for criteria such as discharges 
and transfers. The present study js aimed at 
determining the degree to which ratings on 
these two scales are comparable, as well as 
answering several questions regarding the test- 
retest reliability of the MRSPP. The adminis- 
tration of the MRSPP requires highly trained 
personnel, while the HAS can be used by 
ward personnel with relatively limited train- 
ing. Therefore, in most instances, it would be 
] to use the HAS if the meas- 
urement of patient adjustment obtained on 
the two instruments are highly correlated. 
The degree to which the two instruments 
correlate with one another is, of course, a 
function of the reliabilities of each of the in- 
struments. A further purpose of the present 
study is to assess the reliability of these 
scales. Many of the practical applications of 
the MRSPP would require repeated measure- 
ments (of the same patient group) separated 
by some period of time. Such measurement 
would presumably be sensitive to whatever 
changes in patient behavior had been pro- 
duced by treatment. Yet, differences in rat- 
ings might be a product of a number of fac- 
tors quite unrelated to the effects of therapy. 
For example, the test-retest reliability of the 
instrument may vary as a function of the type 
and degree of pathology shown by the pa- 
tient. A cyclic manic-depressive may exhibit 
far greater day-to-day variation in behav- 
jor than would a severely regressed chronic 
schizophrenic. Similarly, the amount of per- 
sonality disorganization demonstrated by any 
given schizophrenic might influence the reli- 


more economica 


213 


214 


ability with which he could be rated. Another 
factor in evaluating the test-retest reliability 
of an instrument is whether or not the same 
rater makes both ratings. Aside from the ob- 
vious chance of contaminated ratings due to a 
rater’s recall of his previous scorings, better 
rapport might be established as a function of 
the patient and rater having discussed the 
same materials earlier. 

To summarize, the present study attempts 
to assess the correlation between HAS scores 
and morbidity scores of the MRSPP and to 
evaluate the test-retest reliability of the 
MRSPP as a function of: (a) whether same 
or different raters make the pre- and post- 
ratings and (b) the degree of morbidity ex- 


hibited by the patients as measured by HAS 
scores. 


Procedure 
Subjects 


Thirty-six Ss were drawn from a group of 
240 chronic psychotic, female patients 23 to 
55 years of age. All had been diagnosed 
“schizophrenic” by the psychiatric staff. The 
group from which the experimental sample 
was drawn was housed in two buildings, each 
of which consisted of four wards. Patients 
were assigned to wards according to some 
relatively crude evaluation of morbidity. Pa- 
tients on Ward A, for example, were gener- 
ally less aggressive, more communicative, and 
showed fewer signs of severe regression than 
those on Ward D. Thus, a stratified popula- 
tion was defined with HAS total scores, build- 
ing, and wards forming the three strata. 


Use of the HAS 


The HAS total scores obtained by student 
nurses approximately one month before the 
beginning of the present study were available 
for each of these patients. Before their at- 
tempt to rate members of the experimental 
sample, the 57 student nurses were given 
three two-hour training sessions and two prac- 
tice ratings with patients not in the experi- 
mental sample. In the initial training, the 
meaning of each item on the HAS was dis- 
cussed and clarified. The student nurses were 
then divided into groups of from three to ten 
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members. Each of the members of a group 
rated the same patient whom she had ob- 
served for at least one month. In the training 
session following each practice rating, items 
showing less than 75% agreement between 
raters were discussed, and rules regarding the 
use of these items were prescribed. The dis- 
tribution of the HAS total scores on the ex- 
perimental sample was then divided into equal 
thirds. The first group consisted of scores of 
33 or less; the second, of scores from 34 to 
74, and the third of scores of 75 and over. 


Use of the MRSPP è 


Seven psychologists served as raters on the 
MRSPP. Two had the M.A. degree with three 
and seven years of clinical experience. The re- 
maining five raters had doctoral degrees and 
have had from one to twelve years of clinical 
experience. During a training period, each 
rater administered the scale at least three 
times, with two or more raters evaluating the 
same patient. Following each rating, the re- 
sults for the different raters were compared 
item by item, and those items which most fre- 
quently yielded disagreement were discussed 
by all seven raters. Specific “conventions” 
were adopted concerning those items which 
most frequently showed disagreement in an 
attempt to reduce interrater variability. 

The interview procedure was standardized 
with respect to (a) the opening comments of 
the rater, (b) the use of certain questions 
which it was believed might elicit responses 
which were relevant to items on the MRSPP, 
and (c) questions regarding specific informa- 
tion (e.g., orientation) which was necessary 
to complete the ratings. 

Patients were interviewed about one-half 
hour for each rating. The interviews were 
conducted in private rooms on the ward. An 
aide or nurse was then interviewed in order 
to obtain the information required to com- 
plete the last 22 items of the MRSPP. The 
same aide or nurse was always interviewed in 
obtaining test and retest information for a 
given patient. 


3The rating conventions and interviewing guide 
have been deposited with the American Documenta- 
tion Institute. Order Document No. 5538, remitting 
$1.25 for microfilm or $1.25 for photocopies. 
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Comparability and Reliabilities of Behavior Rating Scales 


Experimental Design 


The basic design of the experiment was a 
2x2x3 factorial in which the variables 
were: (a) same or different rater on test and 
retest, (b) test versus retest scores, and (c) 
low, medium, and high HAS scores. Six pa- 
tients were assigned to each of the 12 cells 
on the basis of the population stratification 
mentioned earlier. Each patient appeared in 
both test and retest categories. The samples 
Were drawn randomly within each combina- 
tion of the population strata, with sample 
probability proportional to the population fre- 
quency. 

No rater was paired with another rater 
more than once under the “different rater” 
Condition, and each rater obtained approxi- 
mately half his ratings under the “test” con- 
dition. Insofar as possible, each rater ob- 
tained an equal number of ratings from each 
ward and each building. “Test” and “retest” 
ratings were obtained three weeks apart. 


Results and Discussion 


The data obtained in this study are sum- 
marized in Table 1. Inspection of this table 
reveals that the only significant main effect 
was HAS score (p < .01)- This indicates @ 
Statistically significant relationship between 
the MRSPP morbidity scores and HAS total 
scores, The Pearson product-moment correla- 
tion between these two variables is — 57. 
The HAS-MRSPP correlation corrected for 
attenuation was — .72- The negative value re- 


Table 1 


Summary of the Analysis of Variance 


F 


Source df m.s. 
HAS 2 3708.88 13.90 
Test-Retest 1 4.50 0.02 
Rater 1 58.67 O 
us by Test-Retest 2 19.73 0.07 
AS by Rater 3 304.55 114 
est-Retest by Rater 1 14.22 0.05 
est-Retest by HAS by Rater 2 43.87 0.16 
ithin cells 60 266.82 
Total y1 34142 
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fers to a positive relationship as high HAS 
scores, and low MRSPP scores are interpreted 
as signifying good adjustment. When test and 
retest scores were obtained two weeks apart 
using student nurse raters, the reliability of 
the HAS was estimated to be .79. With a 
three-week period intervening, the MRSPP 
morbidity scores yielded an .80 reliability co- 
efficient. All three of these correlations are 
significant beyond the .01 level of confidence. 
The fact that the Rater and Test-Retest vari- 
ables were not significant suggests that: (a) 
it makes no difference whether same or dif- 
ferent raters obtain pre- and postmeasures, 
and (b) the MRSPP is sufficiently reliable to 
warrant its use in evaluation studies requiring 
repeated measurements on the same patients. 

Further inspection of Table 1 indicates that 
none of the interactions approach significance 
at the .05 level. The fact that the HAS by 
Test-Retest interaction is not significant sug- 
gests that reliability of group means is not 
a function of level of morbidity as measured 
by the HAS. The lack of significance for the 
HAS by Rater interaction casts doubt on the 
hypothesis that repeated interviewing of the 
same patient has an effect on the degree of 
morbidity inferred by the examiner. The find- 
ing of nonsignificance for the Test-Retest by 
Rater interaction demonstrates that reliability 
is not contingent on whether the same rater 
obtains both test and retest ratings. 


Summary 


This experiment was devised to evaluate 
the utility of two scales widely used to rate 
patient morbidity. A further consideration 
was the reliability of each of these scales. 
In addition, the test-retest reliability of the 
MRSPP was studied as a function of degree 
of patient morbidity and of same or different 
rater on test and retest. 

Estimates of test-retest reliability of the 
HAS and MRSPP morbidity scores were 79 
and .80, respectively. The correlation between 
these two scales was found to be — .57. Fur- 
ther findings with the MRSPP were: (a) 
same Or different raters may be used for ob- 
taining “pre-” and “post” measures, (b) reli- 
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ability of group means is unrelated to level of 
morbidity, and (c) rating a patient more than 
once has no effect on the degree of morbidity 
inferred. 

Both the MRSPP and the HAS were found 
to be reliable instruments for repeated ratings 
of psychiatric patients. For those interested in 
economy, the feasibility of using nonprofes- 
sional raters with the HAS is of considerable 
interest. 


Received June 20, 1957. 
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The Relation of Difficulty in Drawing to Ratings of 
Adjustment Based on Human Figure Drawings 


Marvin J. Feldman and Raymond G. Hunt 
University of Buffalo 


oe clinical use of the human figure draw- 
en from the assumption that a sub- 
Por Py le of expression reflects important 
is wl his personality. More specifically, it 
Le that those aspects of the self sub- 
will f under the concept of “body i mage 
the Iara direct expression in the drawing of 
elucid: man figure. This point of view has been 
elab ated most fully by Machover (1). Her 
i eit of the meaning of figure drawings 
find; to stem in part from empirical clinical 
eae In large part, however; she implies 
muni e phantasy life of the subject 1s com- 
inter cated by a symbolic body language. Her 
ce often parallel psychoanalytic 
mo ns about symbolism, e8» ê concave 

uth reveals concern with dependency needs. 
ma ctsonality may be validly revealed in 
Goit aspects by the individual’s style of 
er Nevertheless, the body Janguage 
ee by figure drawings may not have 

lem exact syntax or logic as 1m 
Leen Further, an interpreter may be 
a by influences other than symbolic 
= Sige Whitmyre (3) as shown 
val r conclusively that the over-all aesthetic 

ue of the drawing is highly related to clini- 


ca. f l 
As of adjustment. In his study, Tat- 
of personal adjustment correlated ->: 

f artistic 


a 

s with independent ratings O iht bi 

argu T for the same drawings. It might be 

ade ed that any disturbance reflecting an in- 

arta ate body image would result in 2 06- 

en re from a smooth, regular drawing; 
ce, the over-all result would be d 


Phere 
e is no good a priori reason 10 
ARR that a self depreciatory body image 

d lead to irregularities in drawing 10 just 


Ose parts of the human figure which arè 


most difficult to draw. The present study in- 
vestigates possible structural factors in draw- 
ing apart from personality needs or traits 
which might unwittingly influence interpreta- 
tions of figure drawings. 


Procedure 


As part of a larger project, 65 students, 39 
men and 26 women, in a lower division course 
in psychology were asked to draw a human 
figure without clothes. The drawings were 
obtained in a regular classroom session. Al- 
ifically instructed to do so, all 


though not spec! 
subjects drew their own sex. Three clinicians 


versed in the use of figure drawings independ- 
ently rated 25 body parts on each drawing 
for specific signs of disturbance. The ratings 
were simple presence or absence of disturb- 
ance for each body part. To promote uni- 
formity of ratings, the clinical judges were 
given prief descriptions of the signs of dis- 
turbance associated with each body part ac- 
cording to Machover (1), e8- for nose— 
overly long oF large, tiny “button nose,” 
heavily shaded or cut off, heavy reinforcing 
of lines, nostrils present. 
Two art instructors in figure drawing * who 
ing about the study were asked to 


rate the same 25 body parts in terms of the 
ease oF ifficulty in learning to draw each 


body part. These ratings were done on a five- 
point scale in which 1 indicated the easiest 
and 5 the most difficult part to learn to draw. 

This study has nO direct bearing on the 


validity of the symbolic meaning of signs on 


1 The authors wish to thank Anne Garson and 
Alexander Russo of the Albright Art School of the 
University of Buffalo and Saul Siegel and Herbert 
Sanderson who served as judges in this study. 
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Table 1 


Interjudge Reliability for Ratings 
of Disturbance 


Judge # 
A vs. B 7 
Avs. C 74 
B vs. C 86 


figure drawings. It would seem to furnish 
some evidence of a possible source of error in 
figure drawing interpretation. 


Results 


The interrater reliability of the art instruc- 
tors’ ratings was only .50. Inspection of the 
data, however, shows that they disagreed with 
one another by more than one step on only 
three items. Hence, it seemed reasonable to 
combine their judgments into an average rat- 
ing for each body part. 

The interrater reliability of the clinical 
judges is shown in Table 1. These correlations 
indicate how well the judges agreed on which 
body parts (not which subjects) were most 
often rated as manifesting disturbance. It can 
be seen that the clinical judges agreed fairly 
well in checking signs of disturbance on the 
various body parts of the figure drawings. In- 
Spection of the data, however, shows that one 
of the judges consistently checked more signs 
of disturbance in rating the drawings. Hence, 
instead of using a raw score average of the 
number of times each body part was checked, 
it seemed advisable to convert each clinical 
judge’s ratings to a set of standard or z scores. 
The three sets of z scores were then averaged. 

The main comparison was then made by 
correlating the average ratings of the two art 
instructors with the average z scores of the 
three clinical judges. The correlation was 
— .53, which is significantly different from 
zero at the .01 level. This negative correlation 
indicates that those body parts which are 
most difficult to draw tend also to be rated 
more frequently as manifesting signs of emo- 

tional disturbance. 5 

Table 2 presents the nm a P 

i ‘ding to artists’ ratings of draw- 
ranked ee frequency with which they 
ing difficulty and freq indicatine ton 
are selected by clinicians as indicating emo- 
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tional disturbance. According to the body-im- 
age theory underlying Machover’s rationale, 
one would expect certain parts of the body to 
be selected by clinicians more frequently than 
others as reflecting emotional disturbance. It 
follows from Schilder’s discussion (2) that 
those parts of the body associated with eroto- 
genic zones (e.g., extensions, openings, geni- 
talia, etc.) will be more highly cathected 
and hence more likely to provide a locus of 
disturbance in figure drawings. Reference to 
Table 2 reveals that this hypothesis is only 
partially fulfilled. Certain supposedly (theo- 
retically) highly cathected body parts such 
as breasts, nose, eyes, etc. are conspicuous by 
their absence among the parts most frequently 
selected by clinicians. 

Moreover, it will be noted that those body 
parts which do conform to expectancy by 
being frequently selected by clinicians tend 


Table 2 


Ranks of 25 Body Parts for Artists’ Ratings of 
Difficulty of Drawing and for Frequency of 
Selection by Clinicians as Indicants 
of Emotional Disturbance 


Disturbance Drawing 
frequency difficulty 
Body part rank rank 

Hands 5 1.5 
Fingers 2 3.5 
Distribution of hair overhead 20 7 
Distribution of hair over body 16 13.5 
Nose 10 13.5 
Waist 19 23.5 
Ears 24 13.5 
Chin 18 Bs 
Body build 12 

Height 25 23.5 
Trunk 15 13.5 
Joints 21 7 
Shoulders 9 13.5 
Arms 3 7 
Chest 17 20 
Breasts 14 20 
Hips 11 13.5 
Legs 6 7 
Feet 4 15 
Posture 13 25 
Weight 22.5 20 
Sex organs 1 20 5 
Mouth 7 7 
Eyes 8 

Beon 22.5 13.5 


os 
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Drawing and Adjustment in Human Figure Drawings 


also to be body parts rated by artists as diffi- 
cult to draw (e.g., feet, hands, etc.). Simi- 
larly, those body parts which fail to conform 
to expectancy, by being relatively infre- 
quently selected by clinicians, tend to be parts 
rated relatively easy to draw (e.g., nose, 
breasts, etc.). 

The only important exception to this is the 
clinician’s rating of sex organs as the most 
frequent source of signs of disturbance. Sex 
organs were rated as easy to draw. Thus, it 
seems that with respect to sex organs, clini- 
cian’s judgments are determined by factors 
other than artistic excellence. On the other 
hand, in terms of body-image theory, it is 
difficult to account for the absence of such 
body parts as breasts and eyes from those 
most frequently selected by clinicians, except 
as a function of some “artistic” variable. 


Discussion 


As was indicated above, the present study 
makes no necessary presumptions concerning 
the validity of symbolic meanings of signs on 
the figure drawing. Rather, the focus is upon 
a possible source of error confounding clini- 
cal interpretations from such drawings. 

It seems quite evident from the data ob- 
tained in the present investigation and from 
related studies by Whitmyre (3) and Woods 
and Cook (4) that a considerable portion of 
the variance in figure drawing interpretation 
may be attributed to structural aspects of the 
drawing as distinct from symbolic aspects 
presumed to reflect personality traits or di- 
mensions. As Table 2 indicates, there is con- 
siderable overlap between those parts of the 
figure most frequently selected by clinicians 
as containing indications of emotional dis- 
turbance and those parts rated most difficult 
to draw by figure drawing instructors (art- 
ists). However, the fact that this overlap is 
something less than complete (e.g., Sex Or- 
gans frequently selected by clinicians but 
rated relatively easy to render by artists) 
suggests that factors other than drawing skill 
are also influencing the clinicians’ judgment. 

Yet the fact remains that clinicians are 


219 


evidently strongly influenced by the “artistic” 
dimension, both in their over-all evaluations 
of the drawing and with regard to specific 
areas of the drawing upon which they base 
judgments. Consequently, the variance at- 
tributed to this source would have to be 
somehow separated out from other sources of 
variance if the figure drawing method is to 
qualify for serious consideration as an effec- 
tive general diagnostic instrument. 


Summary 


In an attempt to investigate possible struc- 
tural factors in drawing, apart from person- 
ality needs or traits which might unwittingly 
influence clinical interpretations of human fig- 
ure drawings, unclothed human figure draw- 
ings were collected from 65 undergraduate 
college students. Three clinicians rated 25 
body parts on each drawing for specific signs 
of emotional disturbance. Two art instructors 
then rated the same 25 body parts along a 
five-point scale of difficulty in drawing. 

A correlation of —.53 was obtained be- 
tween average ratings of clinicians and artists 
for the 25 body parts. This correlation indi- 
cates that those body parts which are most 
difficult to draw tend also to be selected more 
frequently by clinicians as manifesting signs 
of emotional disturbance. 

The implications of this and other similar 
findings for the use of figure drawings in per- 
sonality diagnosis are discussed. 


Received June 21, 1957. 
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On the Relationship Between Manifest Anxiety 
and Intelligence’ 


Charles D. Spielberger 


Duke University 


The Taylor Manifest Anxiety Scale (A 
scale) has been utilized extensively as a 
means of selecting subjects who are assumed 
to differ systematically in motivational level 
(4, 5, 19). Subjects (Ss) who scored high on 
the A scale have been found to perform rela- 
tively better on simple tasks (13, 20) and 
relatively more poorly on complex tasks (6, 
13, 15, 21) than Ss who scored low. However, 
negative correlations between A-scale scores 
and various measures of intelligence have 
been reported in several recent studies (1, 3, 
11). Kerrick (9) found that the A scale was 
significantly negatively correlated with six 
different measures of intelligence or aptitude. 
Grice (8), moreover, has demonstrated that 
inferior performance on a complex task by 
high anxiety Ss could be attributed to intel- 
lectual differences as readily as to differences 
in motivation, These findings have raised the 
question of the validity of the A scale as an 
uncontaminated measure of motivation. 

On the other hand, Farber and Spence state 
that they have “been unable, over a period 
of years, to find any relation between the 
Anxiety Scale scores of college students and 
conventional measures of intellectual ability 
such as entrance-examination scores and grade 
point averages” (7, p. 10). Klugh and Bendig 
(10), Dana (2), Mayzner et al. (12), and 
Sarason (16) have also reported essentially 

zero correlations between the A scale and 
various measures of intelligence. Schulz and 
Calvin (17), who also failed to find a rela- 
tionship between the A scale and intelligence, 


data of this investi- 
1 er based on part of the i 
ee presented at the meetings of the Midwest- 


See sebol Association in Chicago, May 3, 


1957. 


suggested that the contradictory findings cited 
above might be attributed to variations in 
selection procedures at different institutions. 
The present study is concerned with factors 
related to the selection of Ss which may affect 
the relation between the A scale and intelli- 
gence in college students. 


Method 


The A scale was administered to students 
in the introductory psychology ¢ourse at Duke 
University for six consecutive semesters from 
the fall of 1954 through the spring of 1957. 
A form of the test consisting of the 50 anxiety 
items plus the 15 L-scale items of the MMPI 
was utilized. McCreary and Bendig (14) have 
demonstrated that the A-scale items alone 
correlated .96 with the same items embedded 
in the 225-item “Biographical Inventory” em- 
ployed by Taylor (18). The ACE Psychologi- 
cal Examination for College Freshmen (1949 
edition) is routinely administered to all en- 
tering freshmen at Duke University as part 
of a battery of placement tests. Scores were 
available on both scales for 1142 Ss. The data 
were analyzed separately for each sex for the 
total sample and for semester subsamples. 


Results and Discussion 


The means and SDs of the A-scale and 
ACE distributions and the Pearson product- 
moment correlations for the total sample and 
the various subsamples are summarized in 
Table 1.* The correlations between A 
and ACE for the total sample and for tota 
males and total females were not significantly 

2The author acknowledges with appreciation the 


L. 
statistical and clerical assistance rendered by Ann 
Wescott and Sandra Eisdorfer. 
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Manifest Anxiety and Intelligence 221 
Table 1 
Means, Standard Deviations, and Correlations for A-Scale and ACE Distributions 
Males Females 
Mean ACE Mean MAS Pearson Mean ACE Mean MAS Pearson 
Group N ACE SD MAS SD r N ACE SD MAS SD r 
Spring, 1955 2 14 25 131 79 —34** 18 1287 214 107 55 .62* 
pring, 1956 79 1168 211 11.3 63 —.21 44 1245 169 119 7.1 —.02 
Spring, 1957 101 1205 20.9 15.5 7.2 —.16 38 1343 178 144 62 —.17 
Fall, 1954 140 120.3 326 124 78 —-13 119 1282 183 134 59 01 
Fall, 1955 122 124.2 20.7 120 64 —.08 130 131.5 39.5 13.3 64 09 
Fall, 1956 160 1246 18.2 148 7.0 04 119 1311 17.0 154 82 —.19* 
Spring 952 1168 21.9 136 7.2 —.19"* 100 129.0 186 126 67 08 
Fall 422 123.0 246 13.2 7.2 01 368 130.3 31.8 140 69 .00 
Total 674. 120.7 23.8 134 7.2 —.06 468 130.0 25.9 13.7 69 01 
Total sample 1142 1245 251 135 7.1 —.02 
* 05. 
p $ OL, 


different from zero. Although two of the cor- 
relations for the females were significant, in- 
tensive analysis of the distributions of both 
variables for the individual and pooled sam- 
ples failed to suggest any systematic inter- 
pretation of these findings.* Therefore, the re- 
mainder of this report is concerned only with 
male Ss. 


Correlations between A-scale and ACE 


scores for semester subsamples for the males 
ranged from — .34 to -+ .04. Only one of these 
ys was significantly different from zero (two- 
tailed tests), but the magnitudes of the ob- 
tained correlations were found to be related 
to the mean ACE scores of the subsamples. 
The relationship between mean ACE and A- 
scale-ACE correlation is depicted in Fig. 1A. 
‘As the mean ACE increased, the extent of the 
negative correlation between the A scale and 
the ACE decreased. The rank difference cor- 
relation for this relationship was 94. 

Since the SDs for the various subsamples 
of males were approximately equal, the fact 
that the negative correlations between the A 
scale and the ACE decreased and approached 
zero as the subsample ACE means increase 
suggested that the obtained correlations were 

3 The lower end of the range of ACE scores for 
the female sample was severely curtailed. Only 7% 


of the female Ss scored below the 20th percentile of 
the national ACE norms and only 6.8% scored be- 


low the 40th percentile. 


due primarily to the presence of Ss scoring in 
the lower ranges of the ACE distribution. The 
distributions of ACE scores for male semester 
subsamples were compared with the 1949 na- 
tional ACE norms in Table 2. Chi-square tests 
of goodness of fit of the obtained distribu- 
tions to the ACE norms were computed. Rank 
difference correlations between the percentage 
of Ss with ACE scores below the 20th and 
40th percentiles of the ACE norms in a given 
subsample and the A-scale-ACE correlation 
for that subsample were — .94 and — 1.00. 
There was also a perfect positive rank differ- 
ence correlation between the magnitude of 
deviation of a given subsample from the ACE 
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Fig. 1. A. Mean ACE scores and A-scale—ACE 
correlations for each of the six semester subsamples 
for males. B. Mean ACE scores for male freshmen 
by year of entry. 
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Table 2 
Distribution of ACE Scores for Males in Semester Subsamples 
Below Above Chi 
Group 88 89-102 103-114 115-128 129 square 
ACE norms 20% 20% 20% 20% 20% = 
Spring, 1955 14% 25% 14% 24% 24% 4.5 
Spring, 1956 9% 18% 20% 19% 34% 16.0* 
Spring, 1957 4% 12% 24% 27% 33% 28.0** 
Fall, 1954 7% 8% 21% 26% 38% 47.0** 
Fall, 1955 3% 10% 14% 32% 41% 65.6** 
Fall, 1956 2% 10% 15% 34% 39% 81.0** 
* 0 
a $ iooi 


norms as measured by chi square and the A- 
scale-ACE correlation. 

Two types of selection factors seemed to 
operate simultaneously to affect the number 
of Ss falling in the lower ranges of ACE scores 
for the male subsamples in this study. The 
trend of the ACE subsample means, which is 
depicted in Fig. 1A, indicated (a) that male 
Ss who took the introductory psychology 
course in the fall tended to be brighter than 
those who took it in the spring (fall mean 
ACE 123.0; spring mean ACE 116.8; F= 
11.1, p < .001), and (b) that mean ACE 
scores increased in successive spring subsam- 


DISTRIBUTION OF ANXIETY SCORES 


DISTRIBUTION OF ACE SCORES 


i lection 
ig. 2. An explanation of the effects of sel 

vate on the relationship between the A scale and 
the ACE. The solid lines represent the hypothetical 
ing distributions of ACE and A-scale scores in 
ulation of college males. The pony 
lection factors which 

i resents the effects of se ction fa } 
a G the range of the ACE distributions for this 


study (see Table 1 and Table 2). 


sampl À 
an unselected pop 


ples and successive fall subsamples as a func- 
tion of time. A number of poorly understood 
intra-institutional selection factors appeared 
to be responsible for the fact that brighter 
students tended to take the introductory 
course in the fall.* There were no differences, 
however, in either the means or the variances 
of the distributions of A-scale scores for fall 
and spring. Therefore, the differences between 
the fall and spring A-scale-ACE correlations 
seemed to result from the differences in the 
distributions of ACE scores. 

The trends within the fall and the spring 
subsamples seemed to reflect the results of 
selection procedures which have systemati- 
cally reduced the number of male students 
with low intelligence who have been admitted 
to Duke University. The mean ACE scores 
for entering male freshmen for the period of 
time affecting this study (fall, 1951—fall, 
1955) 5 are shown in Fig. 1B. The trend of 


* The introductory psychology course at Duke Uni- 
versity is a one-semester course, and staff members 
who have been associated with this ourse oyi 
number of years have opined that in the spring me 
course attracts a greater number of students who 
have failed the first semester of a two-semester in- 
troductory course in another area. Also, the B 
elective system at the university is such that min 
who are out of step or more poorly organized a 
likely to take the introductory course in the inet 

5 The data for entering freshmen were from {hore 
students who first entered Trinity College (male E 
dergraduate arts and sciences) during the fall en 
mester. Data were unavailable for male treina 
who entered during the spring and summer, PrE 
amounted to only 7% of all Trinity College 
men. 
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increasing mean intelligence in successive 
classes of entering freshmen over this five-year 
period was highly significant (22). 
: An hypothetical explanation of these data 
is depicted graphically in Fig. 2, in which a 
small negative correlation between the A scale 
and the ACE is posited for male Ss. Where a 
sample contains a sizable number of cases in 
the lower ranges of ACE, the negative corre- 
lation between ACE and anxiety is more pro- 
nounced; where there are few cases with low 
ACE scores, the correlation approaches zero. 
Due to the operation of university selection 
procedures and intra-institutional selection 
factors in this study, the range of ACE scores 
is differentially curtailed at the lower end, 
resulting in the obtained correlations which 
varied as a function of the semester and year 
in which the introductory course was taken. 
The extent to which this interpretation can 
be generalized to other populations is difficult 
to evaluate. Most studies of the relationship 
between anxiety and intelligence have not re- 
Ported separate correlations for each sex and 
have not reported data on their intelligence 
score distributions. The above interpretation 
is consistent, however, with the significant 
negative correlations between the A scale and 
measures of intelligence obtained by both 
Grice (8) and Kerrick (9). These experi- 
menters utilized male samples (airmen basic 
trainees) who would presumably be hetero- 
geneous in intelligence with a sizable percent- 
age of their Ss falling in the lower intelligence 
range. Matarazzo and his associates (11) 
found a significant negative correlation be- 
tween the A scale and the ACE (r= — 25) 
in a group of male college sophomores. This 
correlation appears to be somewhat incon- 
sistent with the suggested interpretation of 
our findings in that the mean ACE score for 
Matarazzo’s sample is very high (estimated 
by the present investigator from their Fig. 2 
to be approximately 134; 87th percentile on 
1949 ACE norms). Although data on the ACE 
distribution in the Matarazzo study is not 
specifically reported, the range of ACE scores 
appeared to be moderately heterogeneous and 
might include a sufficient number of cases 
with low ACE scores to account for the ob- 
tained correlation. In this same study, the au- 
thors failed to find any relationship between 
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the A scale and either the CVS (an abbrevi- 
ated version of the Wechsler Bellevue) or 
grade-point averages which points up the im- 
portance of the particular measure of intelli- 
gence used. Calvin et al. (1) found no rela- 
tionship between A-scale scores and IQ as 
measured by the Wechsler Bellevue Intelli- 
gence Test in a group of college Ss (21 males; 
15 females) whose IQ range was 102-141 
(mean 122.75, SD 9.18). When they added a 
second group of 15 Ss (12 males; 3 females) 
with lower scores (range 92-129, mean 108.3, 
SD 10.41), the combined groups yielded 
highly significant negative correlations be- 
tween the A scale and IQ. The emergence of 
significant negative correlations as a function 
of including a number of male Ss with low in- 
telligence is consistent with the interpretation 
of the data of the present study. Calvin et al. 
point out, however, that low IQ in their sec- 
ond group was confounded with scholastic 
difficulty in that Ss in this group were ob- 
tained from a how-to-study course offered 
for students having scholastic difficulty. 

While Kerrick’s statement that it is “virtu- 
ally impossible to select extreme subjects on 
the Taylor scale who are equated in intelli- 
gence” is obviously not consistent with the 
data, the implication of the studies cited above 
and the findings of the present study are that 
a small negative correlation between anxiety 
and intelligence may be found in male col- 
lege Ss if one samples a wide range of intelli- 
gence and if the sample contains a sizable pro- 
portion of Ss from the lower part of the range. 
However, this correlation may be obscured by 
variations in selection procedures which cur- 
tail the range of intelligence. It should be 
noted that the present study offers no explana- 
tion for a relationship between the A scale 
and the ACE, nor does it answer questions 
pertaining to the validity of the A scale as a 
measure of motivation. It does suggest that 
experimenters selecting male Ss on the basis 
of the A scale should control for intelligence, 
especially when studying heterogeneous popu- 
lations with low mean intelligence. 


Summary 


Scores on the Taylor Manifest Anxiety 
Scale and the ACE Psychological Examina- 
tion for College Freshmen were obtained for 
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six consecutive semesters from a total of 1142 
students enrolled in introductory psychology 
courses. The correlations between the A scale 
and the ACE for the total sample, total males, 
and total females were not significantly dif- 
ferent from zero. Although only one of six se- 
mester correlations for the males was signifi- 
cant, the magnitudes of these correlations 
were highly related to the mean ACE scores 
for these subsamples. Where a subsample con- 
tained a sizable proportion of Ss with low 
ACE scores, the negative correlation between 
the A scale and the ACE was more pro- 
nounced; where there were few Ss with low 
ACE scores, the correlation approached zero. 
It was suggested that a small negative corre- 
lation between the A scale and intelligence 
may be found in college males if one samples 
a wide range of intelligence and if the sample 
contains a number of Ss from the lower part 
of the range. However, this correlation may 
be obscured by variations in selection pro- 
cedures which curtail the range of intelligence. 
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Anxiety: 


One way of determining if a construct or 


dimension, such as anxiety, is unitary is to 

examine its relationships with other con- 

structs and with the observables which help 

fined directly in terms of a number of inde- 
D 


¥ 


to define the constructs. If a construct is de- 
pendently measurable observables, one can 
look for empirical relationships among the 
observables which should reflect something 
about the construct. The conclusion that a 
single dimension is sufficient to account for 
all of the variables presumed to represent a 
Construct like anxiety requires not only that 
all of the variables are substantially corre- 
lated, but also that the correlations among 
all of the measures are due to a single com- 
mon factor to which all of the measures are 
mutually related. The present study seeks to 
assess relationships among a number of pur- 
ported measures of anxiety in order to deter- 
mine the degree to which these reflect a 


single dimension. 


= 


Method 
Subjects 
From the admissions to a neuropsychiatric 
hospital, 37 male patients were selected ran- 
domly, with the exceptions that those with 
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thor was at the Menninger Foundation as & U. S. 
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the National Institute of Mental Health. 


2 Published with permission of the Chief Medical 
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Unitas or Multiplex?*? 


Douglas N. Jackson 
Pennsylvania State University 


and Robert Bloomberg 
VA Hospital, St. Cloud, Minnesota 


known organic pathology, as well as those 
with ages in excess of 45 years, were ex- 
cluded. The age range was 19-43 with a 
median of 30 years. Diagnostically, the group 
was composed as follows: schizophrenic reac- 
tion, 22; manic-depressive, 1; psychoneurotic 
(including depressive) reaction, 13; alcohol- 
ism, 1. 


Procedure 


Four measures were administered to each 
S: (a) The Wechsler-Bellevue digit span 
score, which Rapaport (10, pp. 185-193) has 
put forth as a measure of anxiety without 
confirmation in later studies (6), and a vo- 
cabulary scale (11) to permit statistical con- 
trol of verbal intelligence in assessing digit 
span performance; (b) the Taylor Manifest 
Anxiety Scale (13), administered as part of 
the Minnesota Multiphasic Personality In- 
ventory (MMPI); (c) two one-minute ob- 
servations of the blink rate, recorded while 
the S viewed a drawing of a triangle mounted 
on a vertical plane 60 inches from his line of 
sight; (d) the fingerprint stain test of palmar 
sweating. 

The blink rate. Meyer (7) reviews the em- 
pirical evidence for considering the blink rate 
as an indicant of anxiety. For example, when 
an individual is under stress, as he is while 
undergoing cross-examination in a court of 
law, the blink rate increases (9). Meyer offers 
a theoretical interpretation which attributes 
the interaction of simultaneous responses to 
a convergence of impulse patterns upon the 
motor pathways of the central nervous sys- 
tem. Variations in the blink rate are at- 
tributed to excitation from these neighbor- 
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ing channels. The Corrected split-half reli- 
ability of the blink rate index was .91 in the 
Present study. 

The fingerprint stain test of palmar sweat- 
ing. Mowrer, Light, Luria, and Zeleny (8) 
review the successive developments of this 
device. It was validated by evidence that it 
decreases in therapy (1, 5) and in a relaxing 
situation (3), while increasing under stress- 
ful conditions. Anxiety neurotics have shown 
greater palmar sweating than “normals” (5). 

The test, described by Mowrer et al. (8), 
consists of dabbing a solution of anhydrous 
ferrous chloride on the index finger and al- 
lowing it to dry for one minute. The S is 
then instructed to place his index finger (at 
one pound pressure as measured by a scale) 


Results > 


Product-moment correlations were com- 
puted among the four measures. Table 1 in- 
dicates that none of these correlations are 
significantly different from zero. When the 
vocabulary score is partialled out of correla- 


Table 1 
Correlations Among Anxiety Measures 
Taylor 
Digit Anxiety Blink” 
Measures span scale rate 
Taylor Anxiety scale a ait 
ape ee ae 


Palmar sweating 


* Covariance attributable to verbal knowledge partialled out, 


Douglas N. Jackson and Robert Bloomberg 


tions involving the digit span measure, the 
range is from — .17 to + 02. 


Discussion 


If these results concerning lack of relation- 
ship between assumed measures of “anxiety” 
prove reliable, and an extensive factor ana- 
lytic study by Holtzman and Bitterman (4) ; 
supports this finding, a careful scrutiny of the 
conceptualization and experimental definition 
of anxiety seems in order, [ 

One possibility is to consider anxiety as & 
second-order factor, and consider the primary 
factors to be such dimensions as muscular 
tension, palmar sweating, etc., analogous to 
the situation now prevailing in the area of 
human abilities. This would be true only if 
there was some correlation between the pri- 
mary factors. The evidence on this point is 
incomplete, but if various proposed measures 
of anxiety can be placed along orthogonal 
axes and are completely unrelated, one no 
longer has a meaningful single dimension or 
grouping of correlated dimensions of anxiety, 
but is left with a less parsimonious, but pos- | 
sibly more realistic, structure of independent 
dimensions of such things as muscular ten- ; 
sion, of palmar sweating, and, among other p? 
things, a dimension of test-taking behavior, ] 
the principal factor of which may be best 
exemplified by the Taylor scale or the MMPI 
K scale. z 

The evidence reported here cannot but raise 
questions concerning the generality of at least 
some of the measures employed. Widespread | 
and uncritical use of the Taylor scale as an 
indicant of anxiety, for example, may lead to 
misleading results and erroneous conclusions | 
based only to a minor extent upon variance |” 
associated with “manifest anxiety” and to a 
greater, if unknown, extent upon such de- 
terminants as response acquiescence (2), S0- 
cial desirability, or other superfluous factors. 


Summary b: 


In order to gather preliminary euda 
concerning the extent to which four supposed . 
indicants of anxiety could be coBsidered to 
tap the same or related dimensions in a pop i 
lation of male functional psychiatric pospite 
patients, the following tests were admin Fe 
tered: (a) digit span; (b) Taylor Anxiety 


Anxiety: Unitas or Multiplex? 


scale; (c) fingerprint stain test of palmar 
sweating; and (d) blink rate. 

1 Although the measures were acceptably re- 
liable, their intercorrelations failed to depart 
Significantly from zero. These results, when 
Considered with other evidence, suggested that 
manifestations of anxiety are multidimen- 
sional rather than unitary and may even rep- 
resent uncorrelated dimensions. This may 
necessitate a conceptual reinterpretation of 
anxiety and cautions against the uncritical 
acceptance of a single measure as an indi- 
Cant of generalized anxiety. 
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Test Anxiety Questionnaires’ 


George Mandler and Judith E. Cowen? 


Harvard University 


The increased use of paper-and-pencil tests 
for the measurement of anxiety makes it ap- 
propriate to communicate the following addi- 
tional information on one of these instru- 
ments. 

The college form of the Test Anxiety 
Questionnaire (TAQ) was first described by 
Mandler and Sarason (3). A high school form 
has since been developed by Cowen (1). 
These questionnaires were designed to elicit 
self-ratings on items descriptive of anxiety re- 
actions in test situations. The college form 
contains 39 items, of which four are fillers; 
the high school form contains 52 items, in- 
cluding four fillers.* Each item consists of a 
graphic scale with the end points marked with 
written description and the midpoint indi- 
cated. The subject is free to mark each indi- 
vidual scale anywhere along the continuum. 


Scoring 


Originally, the TAQ was scored by divid- 
ing each scale into 10 intervals and assigning 
a score of 1 to 10 to the subject for each 
scale. A median was then established for the 
distribution on each individual scale and each 
subject received a score of zero or one de- 
pending on whether his scale response fell be- 
low or above the sample median. Sarason and 
Gordon (5) have presented scoring norms 
based on this system. 


1 Parts of this research were supported by a grant 
from the Laboratory of Social Relations, Harvard 


niversity. i 
ye at Department of Education, Waterbury, 


Se the two questionnaires and detailed 
structions have been deposited with the 
Documentation Institute. Order Document 
remitting $1.75 for microfilm or $2.50 for 


scoring in 
American 
No. 5485, 
photocopies. 


A preferable method of scoring the TAQ is 
to sum the raw scores on the individual items, 
thus eliminating the tedious determination of 
medians for each item, which may vary from 
sample to sample. An empirical comparison 
of the two scoring systems on two independ- 
ent samples yielded product-moment correla- 
tions of .95 (N=81) and .93 (N =41)- 
Thus, the new scoring system adequately ful- 
fills the function of the old, while at the same 
time saving considerable time and effort and 
eliminating the need for norms specific to the 
sample.* 


Reliability 


The test-retest reliability of the college 
form of the TAQ is .91 (NV = 70), the split- 
half reliability is .91 (N= 100) (6). The 
split-half reliability of the high school form 
of the TAQ is .90 (N = 286). 


Norms and Sex Differences 


The college form of the TAQ was adminis- 
tered to a group of Harvard-Radcliffe sopho- 
mores and juniors (W = 99) and a group a 
Boston University freshmen and sophomores 
(N = 80).? The high school form was ad- 
ministered to a group of Watertown, Mi 
chusetts, high school sophomores (e 
Table 1 shows means and standard 
for these groups by educational lev 
sex, 

All the means on the college form are 
the midpoint of the theoretically pos 


#If the TAQ is considered as a composite ° 
different scales, Gulliksen’s discussion (2) oe em- 
termination of composite scores is relevant. edicted 
pirical relationship found here could be p (has) 
from his analysis, namely, that “the test me ween a 
no effect whatever on the relationship bety 
test and the composite of which it is a part. 


5 The data were supplied by Michael Mace 
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Table 1 


Means and Standard Deviations on Two 
Forms of the TAQ 


Form and group N Mean SD 
College Form 
Harvard Radcliffe sample 99 179.8 38.6 
Male subjects 66 179.8 38.5 
Female subjects 33 179.7 39.6 
Boston University sample 80 167.1 47.8 
Male subjects 48 158.7 48.4 
Female subjects 32 179.7 44.5 
High School Form 
Watertown sample 286 245.9 41.1 
Male subjects 151 239.17 41.5 
Female subjects 135 253.55 39.2 


range, which is 35 to 350. The Harvard-Rad- 
cliffe sample shows a higher mean than the 
Boston University sample. The only signifi- 
cant sex difference (women scoring higher 
than men) appears on the Boston University 
sample (p = .05). The Watertown sample on 
the high school form (which is scored on a 
nine-point scale) also has a mean near the 
theoretical midpoint (range is 48 to 432) and 
sex differences in the same direction as the 
Boston University sample, although these are 
not significant. 


Test Anxiety and Other Measures 


Since test anxiety has been hypothesized to 
be operative in test situations, the relation be- 
tween the TAQ and intelligence tests is of in- 
terest. Sarason and Mandler (6) reported a 
correlation of — .209 (p < .05) between the 
TAQ and the Henmon-Nelson Test of Mental 
Ability, college form. Cowen (1) reported a 
similar correlation between the high school 
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TAQ and the Otis Gamma of — .185 (p< 
.02).° 

Finally, the relationship between the TAQ 
and the widely used Taylor scale of Manifest 
Anxiety (7) is of interest. Raphelson (4) re- 
ported a correlation of .53 (W = 24). A rep- 
lication on a Harvard-Radcliffe sample re- 
sulted in a correlation of .59 (N = 35). This 
consistent positive relationship between the 
two scales indicates some communality of 
traits measured, but is too low to permit 
either substitution of the two scales for each 
other or any uncritical comparison of the re- 
sults obtained by the use of these instru- 


ments. 
Received May 23, 1957. 
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The number of Papers which have been de- 
voted to discussions of Possible relationships 
between emotions and allergy would seem to 
make any systematic review of the literature 
somewhat redundant. The interested reader 
will find reviews of this work in Leigh (5) 
and in Dunbar (1), 

A central focus of discussion in recent years 
has been the formulation generally credited to 


to be an important factor in the Personality 
and somatic Symptom-patterns of the clini- 
cally allergic child” 
ore recently, Harris and Shure used the 
- unhampered appraisal of the teacher 
who observes the child day after day in the 
natural setting of the classroom es 


“ 


matic children. Additionally, these authors 
wisely pointed out that the range of clinical 
observational techniques which have been 
brought to bear on the attempted resolution 
of this problem are extremely susceptible to 
the error of subjective influence. 


i hank Seymour B. Crepea, 

1 The author, wishes to th l c ( 
Associate Professor of Medicine, for his technical as- 
sistance and helpful comments during the course of 


this research. 


It was reasoned that if maternal rejection 
and a subsequent unsatisfied longing for love 
are indeed associated with allergic sensitivity, 
then a hypothesis derivable from a systematic 
extension of this classical formulation would 
be that the allergic individual would have a 
greater need for recognition than will indi- 
viduals who do not demonstrate allergic sen- 
sitivity. This need for recognition might be 
thought of as an attempt to gain a kind of 
belated mastery over the impulses which have 
been frustrated during an earlier period. Thus 
the task of the present study was to subject 
to systematic experimental analysis the hy- 
pothesis that the need for recognition | is 
greater in a group of individuals receiving 
treatment for allergy than in a control group. 


Method 
The Technique 


The Iflund Test (4), which is based on the 
system of psychological needs contained in 
Murray’s theory of personality (9), was ad- 
ministered individually to each of the subjects 
(Ss). Essentially, this is a memory test which 
consists of 51 pictures, 17 for men, 17 for 
women, and 17 for both. Thus 34 pictures are 
used in any single test. Each of 28 pictures is 
designed to represent a specific need (e.g., 
autonomy, exposition, abasement, recognition, 
etc.) and they are Presented serially at con- 
stant intervals to the S. Three “bland” pic- 
tures are shown at the beginning and three 
at the end of the series in order to minimize 
the effects of Primacy and recency of ex- 
posure. Following each series of exposures the 
S is asked to describe those he remembers. 
The exposures are repeated until the S has 
recalled the entire series. Some are recalled 
after the first showing, others after several 
showings. The assumption is made that the 
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order in which the S recalls the pictures is 
related to his personality organization. Addi- 
tionally, representations of needs which are 
being gratified are recalled earlier, and repre- 
sentations of ungratified needs are recalled 
later. It was hypothesized that since the need 
for recognition of the allergic individual is 
Manifest rather than repressed, the pictorial 
representation of this need would be recalled 
earlier. Previous investigation (4) clearly 
demonstrated that the order of recall is de- 
termined primarily by the meaning of the 
Pictures which is in turn related to the per- 
sonality of the individual. 

In the present study, the actual testing was 
done by a psychologically unsophisticated re- 
search assistant who was not aware of the spe- 
Cific hypothesis under examination. It was 
felt that this would serve as further insurance 
against the possibility of the examiner’s com- 
municating subliminal cues to the S. 


Subjects 


The experimental group was composed of 
35 students, 20 males and 15 females, who 
were receiving regular immunologic treatment 
for allergic rhinitis and/or asthma at the al- 
lergy clinic of the University Student Health 
Department. A purely operational definition 
of allergy in terms of patients who had been 
placed on an immunologic regimen by either 
their own physicians or members of the clinic 
staff was employed. In short, allergy was de- 
fined only in terms of those individuals who 
were receiving treatment for allergy. No ef- 
fort was made to recheck or validate the diag- 
nosis. Under these relatively loosely defined 
conditions it is quite likely that some mis- 
diagnosed individuals were included in the ex- 
perimental group. However, it can readily be 
seen that to the extent to which this is so, the 
resultant error would tend to attenuate rather 
than confirm the hypothesis. 

The technique of matched c 
with each allergic patient bei 
a nonallergic peer for sex, agi 
education. The mean age of the group was 
20.97 years with a range from 17 to 29 years. 
Controls were drawn from various extracur- 
Nicular college groups. 


ontrol was used 
ng paired with 
e, and level of 
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Results 


In order to establish a quantitative meas- 
ure or a recall score, a T score was computed 
for each need picture expressing the number 
of showings for that picture relative to the 
total number of showings required. This 
method tends to equate the Ss in terms of 
general memory ability since the actual score 
is a ratio. The mean T score for both groups 
was 70.07. The mean T score for the allergy 
group was 62.2, while that for the control 
groups was 77.9. The nonparametric sign test 
was employed in the analysis of the data, and 
this difference was found to be significant at 
beyond the .01 level of confidence, demon- 
strating that the ideational representation of 
the need for recognition was recalled signifi- 
cantly earlier among the allergic group than 
among the controls. No differences between 
the sexes were observed nor were the groups 
differentiated by any of the other variables 


which made up the total test. 
Discussion 


These results suggest confirmation of the 
thesis that, within the definition of the sam- 
ples employed, the need for recognition is 
prominently associated with the personalities 
of patients who are on an immunologic regi- 
men. The fact that the significant difference 
occurred in the form of early recall suggests 
that this need is, at some level, being satis- 
fied, possibly by the ritual which is associated 
with allergy. 

It should be made abundantly clear that 
there is no intent to imply that these data 
denote a causal relationship. The present 
study was designed to provide a methodologi- 
cally rigorous test of an essentially clinical 
assumption, and it is felt that this task has 
been fulfilled. Whether the constellation of 
factors which are inferable from these find- 
ings are cause for, or a reflection of, the al- 
lergic condition remains a problem for future 


research in this area. 


Summary and Conclusion 


The hypothesis that there is a greater need 
for recognition among a group of individu- 
als being treated for allergic sensitivity than 
among a control group was tested with a uni- 
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versity student health population. Within the 
definition of the method and the sample the 
hypothesis was confirmed. It was emphasized 
that no causal relationship was implied by 
these findings. 
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Chance Frequency in Matching Problems 
When Success or Failure is Reported 
After Each Matching Operation 


Alan H. Roberts 
Elgin State Hospital 


n Despite the relative importance of match- Bush (2) concerning the statistical analyses 
ing procedures in clinical investigations, the of several matching designs. 

sources most often consulted by psychologists An extremely useful matching procedure 
contain very little information concerning the whose treatment has been neglected is one in 
statistical treatment of these kinds of data. which » different objects are to be matched 
an article by Dudek with n different categories and the judge is 
(1) which provides a formula and tables for to be informed of the success or failure of 
determining chance probabilities when n dif- each matching operation as he proceeds. An 
ferent categories are matched with 7 different example of this procedure might be an ex- 
objects, and a discussion by Mosteller and periment in which clinical psychologists are 


Among the exceptions are 


Table 1 


and Proportions (Bold-faced Type) When n Items are Distributed into 


* Chance Frequencies (Roman Type) 
mee: : d Success or Failure is Reported After Each Match 


n Categories an 


A ES 
ge T o aaa a 
i. az= r R M O 


Number of correct matches (r) Total 
Items orders 
(n) 1 2 3 4 5 6 7 8 9 10 (a!) 

2 1 1 à 
5000 5000 

3 2 3 1 5 
3333 -5000 1667 

4 6 11 6 1 4 
2500 —-.4583 2500 = 0417 

5 24 50 35 10 1 120 
2000 -4167 2917 0833 0083 

6 120 274 225 85 15 1 720 
1667 -3806 3125 -1181 -0208 -0014 

7 120 1764 1624 735 175 21 1 5040 
1429-3500 3222 .1458 0347 .0042 .00020 

8 5040 13068 13132 6769 1960 322 28 1 40320 
1250 = 3241 3257 1679 0486 0080 .00069 .000025 

9 40320 109584 118124 67284 22449 4536 546 36 1 362880 
1111 3020 3255 -1854 0618 0125 .0015 .000099 .000003 

10 362880 1026576 1172700 723680 269325 63273 9450 870 45 1 3628800 

i .1000  .2829 3232 1994 0742 0174 .0026 .00024 .000012 .0000003 
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234 Alan H. 
asked to match 2 Rorschach protocols with 
n different diagnostic categories. In such an 
experiment, the subjective probabilities in fa- 
vor of the judge might be increased if he 
were told the success or failure of each match 
as he proceeds so that he might be given a 
second chance to match a given protocol if 
the first match were in error. The judge 
matches the first Protocol with one of the 
diagnostic categories. If the match is correct, 
he is so told, and the Protocol together with 
its diagnostic Category is removed. If the 
match is incorrect, he is so told, and the 
protocol together with its correct diagnosis is 
removed. Either correct Protocols or correct 
diagnoses may be removed so long as the pro- 
cedure first used is Continued throughout the 
experiment. The Procedure is repeated until 
” matches have been made. The experimenter 
must then determine if the number of correct 


matches achieved js likely to have arisen by 
chance, 


Roberts 


When a procedure of this type is followed, 
the tables supplied by Dudek are not appli- 
cable. The correct chance frequencies and 
their corresponding Proportions are shown in 
Table 1 for n = 2 to 10, Where n > 10, the 
Correct frequencies can be derived from this 
table by means of the formula 


X» = (n — 1)(X) + 


where X,” is the chance frequency of obtain- 
ing 7 correct matches out of n pairs. 


n-1 
rag 
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An Unprofitable Application of the Semantic 
Differential** 


Jack Block 


Institute of Personality Assessment and Research, University of California, Berkeley 


Since the development of the semantic dif- 
ferential (2), the technique has achieved a 
variety of research applications. Central to a 
number of its usages has been the assumption 
that in some degree, in some fashion, the tech- 
nique reveals relationships among concepts of 
which the subject may be unaware. If not yet 
deemed a measure reflecting of the uncon- 
scious, a number of investigators still have 
suggested the technique “pulls” information 
related to some underlying, complexly sym- 
bolic mediating process which is a powerful 
determinant of behavior but which the sub- 
ject is unable to report directly. 

This assumption is an important one to 
test, for, if it is correct, we can bring the 
technique to bear upon a large number of 
substantive problems. If the assumption is in 
fact unwarranted, then we are engaging in an 
uneconomical self-deception where more di- 
rect and simpler procedures are already avail- 
able. The present note reports on an empirical 
test of the assumption of the “depth-penetra- 
tion” of the semantic differential. 

A sample of 112 students in a large intro- 
ductory course in psychology at the Univer- 
sity of California served as subjects (Ss). 
Each S was provided a booklet and asked to 
describe his ideal self and his like-sexed par- 
ent by means of the semantic differential 
technique. The connotative scales employed 
for these descriptions came from an Osgood 
report (2), and a seven-point rating con- 
tinuum was specified. 


1 This investigation, part of a larger research proj- 
ect, was supported by Research Grant M-1078 from 
the National Institute of Mental Health of the 

Nited States Public Health Service. i 
i ° The writer is indebted to John Enright for his 

lp in evaluating the results of this study. 


Following the semantic differential descrip- 
tions, each S was asked to check a list of 80 
adjectives so as to describe his ideal self and 
then to check the adjective list so as to por- 
tray his like-sexed parent. Adjectives were to 
be identified as “characteristic or true,” as 
“uncharacteristic or false,” or as not espe- 
cially relevant for the description. 

Where the semantic differential descriptions 
were recorded on separate pages of the test 
booklet, the adjective descriptions were re- 
corded on immediately adjacent (and immedi- 
ately comparable) columns. This arrangement 
of material was intended to reduce the prob- 
ability of direct comparison by the S of his 
semantic differential descriptions while ac- 
centuating the likelihood of comparison with. 
the adjective list. 

From these data, two sets of scores were 
derived. The similarity of one’s ideal self to 
one’s parent represents a kind of identifica- 
tion (4, 5). The similarity of the two semantic 
differential descriptions provides one measure 
of this identification and was quantified by 
computing the “distance” (1, 3) between the 
semantic descriptions. Presumably, the extent 
of identification as measured in this manner 
was not under voluntary control by the Ss. 
The two adjective descriptions were similarly 
contrasted and a “distance” score computed 
for each comparison. Because of the apposi- 
tion and manifestness of the adjective charac- 
terizations, it may be presumed that identifi- 
cation as measured in this way is under ap- 
preciable control by the participating Ss. 

The anticipation with which this study be- 
gan was that some individuals would show a 
closeness of ideal self and like-sexed parent 
descriptions as measured by the direct adjec- 
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tive check-list approach but marked dissimi- 
larity of ideal self and parent as measured by 
the semantic differential. It was hypothesized 
that Ss with this pattern of identification 
would prove to be unusually suppressive or 
repressive individuals, the latter character- 
istics being measured independently. 

The intended analysis never proved worth- 
while, for when the two distributions of dis- 
crepancy scores were correlated, the r ob- 
tained, based upon an N of 92, proved to be 
-73. This Correlation, when corrected for at- 
tenuation became .94, A Corrected correlation 
of this Magnitude means that the disguised 
and manifest means of evaluating identifica- 
tion were functionally equivalent in the way 
they ordered individuals, Information acces- 
sible by the one approach was completely ac- 
cessible also by the other means. 


discrepancy between the cl 
ferential indices, 


a analysis should be 

Spelled out. The group of 112 Ss was par- 

titioned into four subgroups on the basis of 
ifferent 


Each of the subgroups was analyzed sepa- 


the correlation of the 
two measures of identification, The correla- 


Jack Block 


tions between the semantic differential and 
adjective check-list measures, corrected for 
attenuation, ranged from .67 to 1.20 (this 
latter excess is presumably due to a fortui- 
tously low estimate of the reliability of the 
semantic differential measure), so that the 
present findings appear to be generalizable 
over the various response sets observed. In 
the four independent comparisons of the sub- 
groups, the split-half reliability of the seman- 
tic differential identification measure was al- 
ways less than that of the adjective check-list 
measure. For the V of 92, the semantic dif- 
ferential and adjective check-list split-half re- 
liabilities are .70 and -86, respectively. 

Although the semantic differential justifi- 
ably will continue to enjoy widespread usage, 
especially with reference to problems of mean- 
ing and phenomenology, it would appear from 
the results of the present study that the tech- 
nique has certain limitations when it is used 
to develop derived measures of psychological 
functions. In this kind of research context, the 
semantic differential may be a rather com- 
plicated way of developing a measure more 
readily and reliably secured by other means. 
Received July 3, 1957, 
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Varieties of Response Sets’ 
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and Robert D. Wirt 


University of Minnesota 


The importance of response sets has long 
been recognized in animal experimentation. 
There has recently been an increasing aware- 
ness of the usefulness of measures of response 
sets in psychodiagnostic work. Whether re- 
sponse set scales are seen as possible poten- 
tial measures of valid variance as Cronbach 
would think (1, 2), or as measures of some- 
thing which must be corrected for or sup- 
pressed as Fricke suggests (4), all authors 
seem to agree that understanding of response 
sets and the development of scales to measure 
them are necessary for maximal validity im 
Psychological testing. The primary need in 
ai area seems to be more knowledge of the 

aens of response sets. 

AA si it has been assumed that there 
eed a of response sets and many 
hate pee supposedly different response sets 
curate eee there is still no ac 
not al at ee knowledge as to whether 
general resp ca scales measure the same broa 

se set, or whether there are 3 


few speci 
ific respo; d 
nse sı unrelate 
response sets. ets (or many 


Method 


Cadi believed that the above questions 
Bec: best be answered by factor analysis. 
ause the completeness of the factor-ana- 


1 . 
Suen ish to express our gratitude to Sarah 
chools; senior psychologist, Minneapolis Public 
High S k Welter Chapman, principal of Marshall 
of ae ool, Minneapolis; Frances Anderson, teacher 
üdents problems at Marshall High School and her 
the c i whose generous cooperation made possible 
wish ollection of data reported in this study. We also 

in 0 acknowledge the assistance of Chú Cheng- 

g in the analysis of the data. 


lytic results would depend upon the complete- 
ness of the coverage of the response-set area, 
the literature was first searched for previously 
hypothesized varieties of response sets. Meas- 
ures for 11 possible response sets were then 
developed; these were: tendency to agree, 
tendency to disagree, evasiveness, tendency 
to go to the extreme in agreeing or disagree- 
ing, carefulness, speed, tendency to guess, 
tendency to check many items, tendency to 
list many items, tendency to spread judg- 
ments on a rating scale, and tendency to rate 
to the left or right of center. A previously 
studied set to favor certain answer positions 
in multiple choice situations was not included 
because of evidence which cast doubts on ex- 

a set (2). Response-set con- 


istence of such 

sistency (i.e. stability of set demonstrated by 
testing with another scale) was also measured 
tudy for the tendencies to 


in the present S 
agree, disagree, and evade, and for the tend- 
= pread judgments on aà rating scale. 


ency to S] $ 
PA attempt was made to keep the possible 


influence of item content on the test responses 
ans 2 This was done in part by 
eg, part of the rating 
der directions stat- 

e data was gathered un 
a that it was 4 study in ESP and the sub- 
as uess the pattern of a per- 


; o try tog 

bite ae ratings three months previ- 
ously. In those sections where content was 
necessary, an effort was made to minimize its 
influence by using “neutral” content as much 


as possible. For instance, the content for 


minimizing 


2A copy of the Questionnaire has been deposited 
with the American Documentation Institute. Order 
39, remitting $1.75 for 35 mm. 


cument No. 55. 
De for 6 by 8 in. photocopies. 


microfilm or $2.50 
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measures of tendency to agree, disagree, and 
evade was Fricke’s Set T, which consists of 
those items of his Opinion Attitude and In- 
terest Survey (5), which were marked as true 
by 40 to 60 per cent of each of his criterion 
groups. 

The scales were then administered to three 
complete classes of high school seniors, all 
about 17 years old. Fifteen response-set scores 
(11 response sets, four reliability scores) were 
obtained for each of the 69 subjects. 

Each of the 15 response-set variables was 
then correlated with each of the others (prod- 
uct-moment correlations) and the resulting 
matrix was factor-analyzed by the centroid 
method. In order to achieve more nearly ac- 
curate final loadings, the extraction of factors 
was continued to one factor beyond those in- 
dicated to be significant by the application of 
Humphries’ Rule and Tucker’s Phi, and all 
factors were carried in rotation. The nonsig- 
nificant factor was “residualized.” 


Results 


Three of the four response sets checked 
for reliability showed consistency in retesting 
with different scales. The two measures of 
evasiveness correlated + .66; those for tend- 
ency to agree correlated + .56; and those for 
tendency to disagree correlated + .58. These 
correlations are significant beyond the .01 
level. There was no intertest consistency for 
the tendency to spread ratings on a rating 
scale. The correlation between two measures 
of this previously hypothesized response set 
was +.03. A fifth pair of measures which 
could be considered as a measure of response- 
set consistency were the variables: tendency 
to check many adjectives as descriptive of the 
self, and tendency to list many adjectives in 
describing the self. These two variables were 
also significantly correlated (r = + 41). 

Additional results included the finding that 
the tendency to go to the extreme in agreeing 
or disagreeing with personality statements 
about the self was correlated significantly 
with both measures of acquiescence (+ Al 
and + .45) but was not correlated with the 

ures of tendency to disagree and that 
ie was not significantly correlated with 
eh relesstiesë: In fact the ence, ae 
msignifcant (-+ 19), tended: to Show ma 
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Table 1 
Rotated Factor Loadings 


Factor Factor Factor 


Response set I II III h? 
1. Tendency to go to extremes .61 AL -.07 39 
on “neutral” questions 
2. Tendency to agree with 85 —.25 03.79 
“neutral” items 
3. Tendency to disagree with —A6 71 —.07 72 
“neutral” items 
4, Tendency to be undecided —.65 —.51 .02 68 
on “neutral” items 
5. Tendency to agree with 71 03 —.01 51 
"neutral" items 
6. Tendency to disagree with = —.31 82 00.77 
“neutral” items 
7. Tendency to be undecided —.33 —.78 02.72 
on “neutral” items 
8. Tendency to guess 13 —.12 .03 03 
(small score =guessing) 
9. Tendency to carelessness .07 —.19 —.09 05 
(high score =carelessness) 
10. (Time) Tendency to work —.07 34 —15 14 
quickly (high score = 
more time) 
11. Tendency to check many —.02 —.10 53 29 
adjectives descriptive 
of self 
12, Tendency to spread 05 01 —.07 01 
ratings 
13. Tendency to list many ad- =.18 —.03 65 46 
jectives descriptive of 
self 
14. Tendency to spread 13 03 36 15 
ratings 
15. Tendency toratetotheleft —.05 03 16 0.03 


of center on rating scales 
or, tending to rate 
"good" 


those who were most careless tended to work 
more slowly. 

Application of Humphries’ Rule and Tuck- 
ers Phi indicated that three factors were 
necessary to account for the significant por- 
tion of the common variance. The intercorre- 
lations of the factors are as follows: Factors 
I and II, —.16; I and III, +.01; II and 
III, .00. The loadings for the 15 response-set 
variables on these factors are listed in Table 1- 


Discussion 


The results of this study corroborate those 
of other studies which show that test results 
are determined in part by tendencies to m 
spond to items in certain ways regardless © 


he oh 
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the specific content of those items. Response- 
set stability during two testings with different 
scales was demonstrated for the tendencies to 
agree, disagree, evade, and the tendency to 
list or check many items in an adjective check 
list: The data contraindicated the existence of 
2 consistent response set of spreading vs. nar- 
rowing of ratings on rating scales or a speed 
vs. carefulness set. 

_ A study of the factor loadings for Factor I 
indicates that it is a dimension with tendency 
to agree that a statement is true, to make a 
decision and state it on the one hand; versus 
the tendencies to deny, to evade, or to be un- 
decided on the other. 

The second factor seems to be a dimension 
of disagreeing with assertions VS. evading the 
question or being undecided. These data indi- 
cate that tendency to disagree is not simply 
the opposite of an acquiescence set and both 
cannot be measured on a single scale. Tend- 
ency to disagree can be either a tendency to 
evade the committing of oneself to a particu- 
lar assertion, and thus much like indecision, 
and opposed to the making of a positive state- 
ment; or it can be the making of a definite 
negative assertion, and thus be the opposite 


of evasion or indecision. The first factor can 
then be seen as a committing onself vs. eva- 
siveness factor (note that tendency to go to 
the extremes—either very true or very false 
—has a loading of + .61), and the second 
factor can be seen as a positive denial vs. in- 
decision factor. It is to be noted that although 
two scales are needed to measure agreement 
and denial, these two scales in combination 
define all points on the plane in which tend- 
ency to go to the extreme and indecision tend- 
ency are also located. 

Factor III seems to indicate a rather spe- 
cific tendency to list or check many adjectives. 

This three-factor analysis does not, of 
course, indicate that all response sets can be 
measured by three scales. Rather, one of its 
main conclusions is the specificity of response 
sets, Two scales can be used to measure what 
was previously thought of as the separate de- 
nial, acquiescence, tendency to go to the ex- 
tremes, and evasiveness sets, and a third can 


Measure reasonably well both the hypothe- 


sized separate sets of number of adjectives 
listed and number checked. However, the low 
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commonality on the other response sets shows 
a need for further scales to measure them. 
Other studies have reported consistent sets to 
work for speed, to guess, and to place check 
marks in certain portions of rating scales (see 
Cronbach’s review of the literature [2]). But 
each of these demonstrated response sets re- 
ceived very low loadings on each of the fac- 
tors isolated in our study and each had low 
intercorrelation with all the other response-set 
measures. Additional scales would be needed 
to measure them. 

There is a need for measures of, and fur- 
ther research on, all the varieties of response 
sets. The feeling that all that is necessary is 
the study of only those response sets which 
can enter into the particular type of scale 
used in any particular diagnostic setting stems 
from the common, but erroneous, view that 
response sets are only something to be avoided 
or corrected away. For instance, Fricke (4) 
stresses only the usefulness of measures of re- 
sponse sets as suppressor scales and goes on 
to say “Optimal weighting of suppressor and 
uncorrected scores should probably result in 
no correlation between the suppressor and 
corrected scores” (the italics are Fricke’s 
[4]; P- 163). Statements such as the above 
are accurate only in those cases where there 
is no correlation between the response set it- 
self and the criterion for which prediction is 
being attempted. Tf there is a correlation be- 
tween a response set and a criterion, then 
either the “suppression” of that set or the 
neglect to use tests in which that response set 
can operate may lead to lower validities. 

The clinical meaning of such response sets 
is not altogether clear. However, other work 
(5) has indicated, as we would emphasize, 
that these sets are extremely important in 
psychodiagnostics. We might speculate, for 
example, that our Factor III is related to en- 
ergy level or to extroversion, and personality 
scales measuring these dimensions should then 
account for such a factor. Or, it is possible 
that there are development trends in response 
sets which, as we suggested in an earlier study 
(6), distort the results of personality ques- 
tionnaires. Our Factor II, for example, may 
primarily reflect a phenomenon of adoles- 
cence. The same may be said for other fac- 
tors. In an unpublished study by the authors, 
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using college sophomores, we found, for ex- 
ample, high loadings on a common factor for: 
tendency to say “true” to MMPI items, the 
Taylor Manifest Anxiety Scale score, the 
MMPI scale F (all high negative loadings) 
with MMPI scales L, Hy-subtle, and K (all 
high positive loadings). Looked at another 
way, 50% of the variance of the A scale can 
be accounted for by certain “test-taking atti- 
tude” scales. We believe these relate to re- 
sponse sets and are operative whether the 
material is relatively “neutral” or “meaning- 
ful” clinically. It would seem to us naive to 
think that clinically important personality 
syndromes would not include certain response 
sets as relevant clinical features. For these 
reasons, further research in this area is needed 
to find out what are the relations of response 


sets to the various criteria in which we are 
interested. 


Summary 


The consistency and interrelations of 11 
hypothesized varieties of response sets were 
studied. A factor analysis of the intercorrela- 
tion of these response sets yielded three fac- 
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tors: a committing oneself vs. an evasiveness 
factor, a positive denial vs. an indecision fac- 
tor, and a tendency to list or check many 
adjectives factor. The existence of clinically 
relevant response-set factors was hypothe- 
sized. The uses of measures of the varieties of 
response sets and the need for further re- 
search with them were discussed. 


Received July 10, 1957. 


References 


1. Cronbach, L. J. Response sets and test validity. 
Educ. psychol. Measmt, 1946, 6, 475-494. 

2. Cronbach, L. J. Further evidence on response sets 
and test design. Educ. psychol. Measmt, 1950, 


10, 3-31. 
a Fricke, B. G. The Opinion Altitude and Interest 
Survey. Minneapolis: Investor Diversified 


Services, 1955. p 

4. Fricke, B. G. Response set as a suppressor vari- 
able in the OAIS and the MMPI. J. consult. 
Psychol., 1956, 20, 161-169. 

5. Meehl, P. E., & Hathaway, S. R. The K factor as 
a suppressor variable in the MMPI. J. appl. 
Psychol., 1946, 30, 525-564. 

6. Wirt, R. D., & Broen, W. E., Jr. The relation of 
the Children’s Manifest Anxiety Scale to the 
concept of anxiety as used in the clinic. J. 
consult. Psychol., 1956, 20, 482. 


i 
t 


| 


| 


PSYCHOLOGICAL 
TEST \REYIEWS 


New Tests 


Berdie, Ralph F, & Layton, Wilbur R. Minnesota 
Counseling Inventory. Grades 9-12. 1 form. Un- 
timed, (50) min. IBM, Testscor, or hand scoring. 
Inventory booklet ($3.50 per 25); IBM answer 
sheet and profile sheet ($3.60 per 50) ; Hankes an- 
swer sheet ($1.90 per 50) ; profile sheet only ($1.90 
per 50); manual, pp. 27, with hand-scoring keys 
(60¢), with machine-scoring keys (70¢) ; specimen 
set (75¢). New York: Psychological Corp., 1953, 
1957, 


The Minnesota Counseling Inventory is an instru- 
ment for counseling high school students, based on 
two earlier questionnaires. From the Minnesota Per- 
sonality Scale (1941), three scales were taken: Family 
Relationships (FR), Social Relationships (SR), and 
Emotional Stability (ES). Five MMPI scales repre- 
sented by selected and sometimes edited items are L, 
Pd, Sc, D, and Si, which in the new Inventory are 
designated, respectively, as Validity (V), Conformity 
(C), Adjustment to Reality (R), Mood (M), and 
Leadership (Z). Forty-four of the 355 items are not 
presently scored but represent potentialities for the 


development of new scales. 
The extensive data given in the Manual reveal 


both favorable and unfavorable features of the de- 
velopment of the Inventory. Both split-half and re- 
test reliabilities are mainly satisfactory, ranging from 
(56 to .95 in two-grade, one-sex groups, with the 
typical coefficient in the middle .80’s. Standard score 
norms, given separately for boys and girls and for 
grades 9-10 and 11-12, are based on adequate meth- 
ods and numbers. The manual’s suggestions for in- 
terpretation are explicit and appropriately modest. 
One weakness is revealed by the data on validities 
and intercorrelations. Validities of entire scales are 
reported in terms of the CRs of differences between 
the scores of random samples of pupils and of ex- 
treme cases nominated by teachers and school ad- 
ministrators. There is no indication of item analysis 
against a criterion. Some scales, such as SR, differ- 
entiate well, but others, such as R (Sc), fail to do 
So. The tables of intercorrelations show that most 
rs run from 35 to .60, but that the correlations be- 
tween SR and L, and between ES and R, are as 
high as the scales’ reliabilities. The authors might 


well have refined the scales further by item analysis, 
or at least might have warned users that the evi- 
dence points to five interpretable scores, not seven. 
Even so, the Inventory is a serviceable instrument 
for counselors whose knowledge of test construction 
permits them to be aware of its limitations—L. F. S. 


Lamke, Tom A., & Nelson, M. J. Henmon-Nelson 

Tests of Mental Ability. (Rev. ed.) Grades 3-12. 

3 levels, 2 forms at each level. 30 (40) min. Test 

booklet, each level ($3.00 per 35), with manual, 

pp. 24, and record sheet; specimen set (42¢). Bos- 

ton: Houghton Mifflin, 1957. 

The widely used Henmon-Nelson, which first ap- 
peared in 1931, has been given a thorough revision 
and restandardization. The test is now published in 
three levels, for grades 3-6, 6-9, and 9-12. Each level 
contains 90 multiple-choice items in spiral-omnibus 
form, with several types of verbal items predomi- 
nating; there are some numerical items and figure 
analogies. A fourth level, for college students, is in 
preparation. The test booklets are consumable and 
are scored rapidly by the use of a carbon-paper back- 
ing that eliminates the need for a key. Norms for 
each level are provided in terms of percentile ranks 
in grade, grade equivalents, MAs and deviation IQs. 

The content of the revision is based on an exten- 
sive item analysis of the older tests, and the equiva- 
lence of the Forms A and B is well established. The 
separate manuals for the three levels give impres- 
sively favorable data about reliability, congruent va- 
lidity with other tests, and concurrent and predic- 
tive validity with achievement measures. Reliabilities 
generally exceed .90, correlations with other intelli- 
gence tests approximate .75, and correlations with 
achievement are high, typically .70 with relevant 
tests and .60 with school grades. The standardization 
is a model of precise method, using a predetermined 
sample of 250 classrooms stratified by state and size 
of school system. The manual closes with a persua- 
sive argument for the use of omnibus tests, rather 
than of tests with factor scores, for the prediction of 
school achievement. 

In all, the revised Henmon-Nelson impresses the 
reviewer as a scholarly example of the best in test 
construction, and as a remarkably efficient instru- 
ment for its length —L. F. S. 
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Personal Adjustment: an Approach 
through the Study of Healthy Personality 


By SIDNEY M. JOURARD, Ph.D., Associate Pro- 
Sessor of Psychology, University of Florida. Written 
from a positive point of view, this unique work dis- 
cusses the factors determining the healthy, adjusted 
personality. The author outlines each aspect of per- 
sonality and compares the normal, unhealthy and 
healthy versions of the trait in question. The sections 
on expositions of interpersonal relations, love, the self- 
structure, and conscience are new to the field. 

A pre-publication reader comments: “T think it is indeed 
@ new approach to mental hygiene and a Sar better one 
than what we now have available.” January, 1958, 462 
pages, $5.50 


INTRODUCTORY CLINICAL PSYCHOLOGY 


By SOL L. GARFIELD, University of Nebraska Medical School. 
Stressing diagnosis, psychotherapy and research, this book pre- 
sents a study of the development and current role of clinical 
Psychology, both as a science and as a Profession. 1957, 469 
pages, $6.00 


DIFFERENTIAL PSYCHOLOGY: Individual and 
Group Differences in Behavior, Third Edition 


By ANNE ANASTASI, Fordham University. Thoroughly revised 
to include recent American and European research in biology, 
anthropology and sociology, the third edition of this au- 
thoritative volume contains much signi 
1958, 664 pages, $7.50 


Lhe Macmillan Company 


60 FIFTH AVENUE, NEW YORK 11, N.Y. 


ficant new material. 
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Further Evaluation of the Archimedes Spiral Aftereffect 


Harold Gilberstadt, Jerome D. Schein 


VA Hospital, Minneapolis, and University of Minnesota 


and Albert Rosen 
State College of Washington 


The present investigation was stimulated by 
the report of Price and Deabler (5) who, 
after testing for the spiral aftereffect on 
groups of normal, nonorganic psychiatric, and 
Organic brain-damaged hospitalized patients, 
concluded: “When failure to perceive the 
aftereffect is found it is almost certain that 
cortical involvement exists” (5, p. 301). They 
state that the results of a previous study by 
Freeman and Josey (1) led them to believe 
that this phenomenon might be used to de- 
velop a technique for the detection of organic 
brain damage. In a subsequent study, Gallese 
concluded that “the test almost always indi- 
cates organicity when organic scores are ob- 
tained although the converse is not true” (2, 


p. 257). 
This study represents an effort to evaluate 


further the spiral aftereffect as a screening 
device for cortical brain damage with a VA 
GM&sS hospital sample. In such a setting 
where large numbers of patients are examined 
for diagnosis and possible acute and intensive 
treatment, it would be highly desirable for 
the clinical psychologist to be able effectively 
to go beyond the mere assessment of the effi- 
ciency of functioning in those areas for which 
we presently have standardized techniques 
such as the Wechsler-Bellevue. There is little 
question that we are still far from able to 
state with any degree of confidence to what 
extent specific functional or organic variables 
contribute to the observed or predicted per- 
formance of the patients we examine. Yet it 
is apparent that our goal in the area of dif- 
ferential diagnosis must be to rely as little as 
Possible on the art of clinical diagnosis which 
IS strong in the tradition of neurology and 


psychiatry and to continually strive to de- 
velop rigorously standardized techniques from 
which statistically sound predictions of known 
validity can be generated. 

The results obtained by Price and Deabler 
were of more than usual interest because, con- 
sidering the complexity of the human organ- 
ism and the nature of the variables involved 
in the loss of function from cortical brain 
damage, it is hard to overcome initially strong 
scepticism toward the claim that a single, 
brief test of one modality could develop into 
an almost infallible sign of such damage. As a 
consequence, the study by Price and Deabler 
seemed to demand further evaluation. 


Method 


Every effort was made to follow the instruc- 
tions of Price and Deabler for administering 
the test. An Archimedes Spiral of 920°, or 
two and one-half turns about its center, was 
constructed by painting a black spiral on a 
white background. This wheel was affixed to 
a reversible motor with a variable speed con- 
trol which was set at 100 rpm for the experi- 
ment. The apparatus was placed in an inside 
room which was well illuminated by fluores- 
cent lighting. The spiral was placed at eye 
level and the subject was seated at a distance 
of eight feet from the apparatus. 

One experimenter was employed to test all 
of the patients. Four trials were given alter- 
nating clockwise and counter-clockwise rota- 
tions. Scoring was on the basis of 1 or O for 
each trial. Samples of responses to the after- 
effect scored 1 were: “It’s coming toward me.” 
“Getting larger.” “Expanding.” “Going in the 
opposite direction.” “Swelling.” “Shrinking.” 
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“Opposite.” Samples of 0 scoring were: “Noth- 
ing.” “Stopped.” “Standing there.” “Standing 
still.” “Same.” 

A check of scoring reliability by four judges 
on the first 35 cases showed no disagreements 
except for one instance in which a judge mis- 
read the handwriting on the recording form. 


Sample 


During a three-month experimental period 
all available patients admitted to the Psy- 
chiatry and Neurology Services respectively 
were tested. The total number of admissions 
to Psychiatry were 112 and to Neurology 175. 


Table 1 


Diagnoses and Scores on Archimedes Spiral Aftereffect 
of Psychiatric Sample 


(N = 87) 


Distribution of 
Scores 


Diagnosis Oo 2A s 1% 


Organic (N = 7) 


Acute brain syndrome associated 

with alcohol intoxication 1 
Chronic brain syndrome with 

psychosis ts 
Encephalitis, epidemic chronic 1 
Encephalopathy, chronic progres- 

sive 1 
Depressive reaction with hyper- 

tension and cerebral vascular 

accident il 
Alzheimer’s disease 1 


Nonpsychotic (N = 57) 
Anxiety reaction 5 a 
Conversion reaction 
Depressive reaction Fa ta 
Dissociative reaction 1 
Obsessive-compulsive reaction 
Psychophysiologic reaction 
Adult situational maladjustment 
Chronic alcoholism 
Dysocial reaction : 
Emotional instability reaction 1 1 
Inadequate personality 
Mental deficiency 


m 


RRR Ror PRD UES 


Psychotic (V = 23) 
Involutional melancholia 1 
Paranoid schizophrenia 
Schizophrenic reaction other 1 
Manic depressive 


moo 
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To maintain standard testing conditions, an 
initial requirement was instituted that only 
patients who were able to come to the testing 
room would be included; the criterion being 
the judgment of the nurse in charge of the 
ward. As a result of this condition; 16 pa- 
tients were omitted from the Psychiatry sam- 
ple. An inspection of the cases showed physi- 
cal illness, assaultiveness, and suicidal risk to 
be the bases of the nurses’ decisions. Seven 
patients were omitted through administrative 
error. Two patients who did come for testing 
were unable to attend to the task. Table 1 
shows the distribution by diagnosis and score 
of the remaining 87 cases which constitute 
the Psychiatry sample. 

Thirty-five patients admitted to Neurology 
were omitted from the sample of these cases. 
Fifteen were discharged before testing could 
be done, six expired, eleven were bedridden, 
three were aphasic and after reporting for the 
test did not have sufficient verbal ability to 
be tested under the standard conditions. 
Table 2 gives the distribution by diagnosis 
and score of the remaining 140 cases. 

Mean age of the Psychiatric sample is 41.2 
years and mean age of the Neurologic sample 
43.4 years. Both groups were tested an av- 
erage of five days after admission. Diagnoses 
in all cases were final diagnoses and were un- 
contaminated by test results which were with- 
held until all diagnoses had been obtained. 


Results and Discussion 


In reporting their findings, Price and Deab- 
ler used the terms “organic,” “brain dam- 
aged,” and “cortical” as though they were 
equivalent. That the first two terms may con- 
vey very similar meaning is understandable, 
but the term cortical has a highly specific 
connotation referring to a particular portion 
of the brain. Price and Deabler’s summary 
statement led us to conclude that, despite the 
ambiguous use of these words, their intention 
was to restrict the test to the detection of 
cortical brain damage. It seemed imperatives 
then, to dichotomize our organic brain sy”- 
drome cases into cortical and noncortical sub- 
samples. Parenthetically, it may be note 
that assigning only cortical cases to the cate- 
gory of expected positives was more favor- 
able to the hypotheses of Price and Deabler 
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Table 2 


Diagnoses and Scores on Archimedes Spiral Aftereffect 
of Neurologic Sample 


(N = 140) 
Distribution of 
Scores 

Diagnosis 0123 4 

Organic brain syndrome” (N = 68) 
Traumatic brain injury 1 12 8 
Demyelinating disease of brain 1 5 
Brain tumor 2 1 a 
Cerebral vascular accident 4 34 
Convulsive disorder 2 4 2 15 
Chronic brain syndrome 1 2 1 
Meningitis 2 
Paralysis agitans 1 3 
Other 8 

Organic non-brain syndrome? 

(N = 56) 9 3 2 i8 "34 
Organic disease not found (V = 8) 5 A 7 
5 


Psychoneurosis® (V = 8) 


are as follows: raumatic 
matic epilepsy; 1 cerebral concussion, 
1 basilar skull fracture, 2 cerebral contusion, 1 penetration 
concussion syndrome, 1 post- 
inating diseases—3 amyo- 
1 primary lateral 


defect. right frontal, a b 
dorsalis, 1 headache with retinal hemorrhages, 1 hypertensive 


strain, 1 Meniere's disease, 1 myotonia dystrophica, 1 nephro- 
1 posttraumatic neuropathy, 24 herniated nucleus 


tosis, r y n 
pulposus, 1 occlusion anterior spinal artery, 3 peripheral 
neuritis, 3 radiculitis, 1 rheumatic heart disease, 1 sacroiliac 


strain, 1 sciatic syndrome, 1 possible slipped disc, 2 syncope of 


undetermined etiology. p 
© Specific diagnoses are as follows: 1 anxiety reaction, 1 func- 


tional cephalgia, 4 conversion reaction, 1 depressive reaction, 1 
Dsychoneurosis severe with paranoid trends. 
than the inclusion of all brain-damage cases 
Would have been. 

We relied on the best judgments available 
to classify our sample on the basis of diag- 
Nosis,! Nevertheless, we did so with reserva- 


go, We wish to thank E. T. Bell, Emeritus Profes- 

Sa, of Pathology, University of Minnesota Medical 
chool, and David Webster of Minneapolis VA Hos- 

SeA neurology staff for their assistance in categoriz- 
E the neurological cases. 
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tion, since a realistic consideration of the 
problem must lead to the conclusion that 
within the limits of a study of this type it is 
not possible to establish a very satisfactory 
criterion of cortical brain damage. Even with 
unlimited resources there still would be seri- 
ous weaknesses in the criterion because of the 
difficulties inherent in the accurate determi- 
nation of the localization and extent of corti- 
cal brain damage with even the best of cur- 
rent neurological techniques. 

Price and Deabler did not elaborate on the 
basis by which they conclude that their cases 
of CNS syphilis, cerebral vascular accident, 
chronic brain syndrome associated with alco- 
holism, cerebral arteriosclerosis, posttraumatic 
encephalopathy, and advanced Parkinson’s 
disease have known cortical involvement be- 
yond stating that the diagnoses were based 
on hospital staff action. Because of our lack 
of confidence in such diagnoses and for the 
reason noted above, we were conservative and 
assumed that only the 30 cases, which in- 
cluded traumatic brain injury, brain tumor, 
cerebral vascular accident, chronic brain syn- 
drome, and meningitis (listed under the or- 
ganic brain syndrome subgroup in Table 2), 
plus the seven cases from the organic sub- 
group (listed in Table 1) have cortical brain 
damage of a pathological degree. 

Meehl and Rosen’s (3) procedure for the 
evaluation of any assessment or prediction 
device was followed in the analysis of the 
test results. In the first three columns of 
Table 3, f denotes the number of diagnosed 
cases of cortical damage receiving each score, 
cf indicates the cumulative frequency and P4 
represents the proportion of the total group 
of those with cortical damage who scored at 
or below each scoring interval. The next three 
columns give the same data for the group 
without cortical damage. In order to conserve 
space we have eliminated the intermediate 
calculations given for illustrative purposes by 
Meehl and Rosen. Hr represents the propor- 
tion of correct classifications for the given 
cutting line; i.e., the number of valid posi- 
tives plus the number of valid negatives di- 
vided by the total number of cases. 

When all cases are considered, it will be 
noted that the test does no better than the 
base rates; i.e., if we simply called all cases 
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Table 3 


Cumulative Frequency Tables for Calculation of Optimal Cutting Scores 
for Archimedes Spiral Aftereffect 


Cortical Noncortical 

Score F cf P, f cf Pa Hr 
0 12 12 3243 13 13 .0684 8344 
1 3 15 4054 9 22 1158 8076 
Combined sample* 2 3 18 4865 7 29 1526 «7896 
3 6 24 .6486 23 52 .2737 «7139 
4 13 37 1.0000 138 190 1.0000 1600 
0 4 4 S714 2 z .0250 9427 
1 3 7 1.0000 4 6 .0750 9310 
Psychiatry cases> 2 3 9 .1125 4.8965 
3 10 19 2375 7815 
4 61 80 1.0000 0800 
0 8 8 .2667 11 11 .1000 aor 

1 0 8 .2667 5 16 1455 731 
Neurology casese 2 3 11 .3667 4 20 .1818 -1234 
3 6 17 .5667 13 33 3000 6720 
4 13 30 1.0000 77 110 1.0000 .2100 


* Base rate for cortical brain damage in this sample is .16, 
Base rate for cortical brain damage in this sample is .08. 
e Base rate for cortical brain damage in this sample is .21. 


free of cortical damage we would correctly 
identify 84% of the sample. Using the test, 
we correctly identify 83.4%, provided that we 
use a cutting score between O and 1. Using 
the cutting line between 2 and 3 suggested by 
Price and Deabler, we would classify the cases 
correctly only 78.9% of the time as compared 
to the base rates of 84%. 

In Psychiatry, where 8% of the sample 
were diagnosed as having cortical damage, if 
the cutting line were set between 1 and 2, 
93% of the cases would be correctly identi- 
fied as compared to 92%, using only the base 
rate and calling all cases non-brain-damaged. 
Maximum effectiveness is again attained with 
a cutting line between O and 1 where 94.3% 
of the cases are correctly identified. 

In the Neurologic sample, the test is un- 
able to improve upon the base rates. By rou- 
tinely calling all cases not cortically damaged, 
79% would be correctly classified. Using a 
cutting score between O and 1 the test would 
attain its maximum number of correct identi- 
fications, 77%. Use of the test, then, would 
result in a 2% decrement in predictive ac- 


curacy. 


In addition to the total number of correct 


classifications, evaluation of a clinical instru- 
ment is dependent upon the importance at- 
tributed to detecting the greatest number of 
cortically damaged cases and to the cost 
and the facilities available for further neuro- 
logical evaluation of mislabeled, noncortically 
damaged patients. If one wished to avoid miss- 
ing any cortical cases regardless of the cost, 
he would choose a cutting line between 3 
and 4 for a population resembling our com- 
bined Neurology and Psychiatry samples. 
This would yield the detection of 64.9% 
(P1) of the cortical cases at the expense of 
misclassifying 27% (P>) of the noncortical 
cases. If one were interested in avoiding ad- 
ditional neurological examinations because of 
staff limitations, he would select a cutting line 
between 0 and 1 where 32.4% of the cortical 
cases are identified, and only 6.8% of the 
noncortical cases are misdiagnosed by the test- 
Table 4 contains a similar analysis of thé 
data presented by Price and Deabler (5); 
Gallese (2), and Page, Rakita, Kaplan, an! 
Smith (4). We have also repeated the data 
for our combined Neurology and Psychiatry 
samples to simplify comparison of all four 
studies. Since none of the other three studies 
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report the base rates for their populations, we 
have used the empirical rate obtained from 
our combined sample (.16) as the estimate 
with which to make the necessary calculations. 

It will be noted in Table 4 that the maxi- 
mum total hit rate (Hr) varies from 96.4% 
in the Price and Deabler study, to 90.4% for 
Gallese, to 81.0% for Page et al., to 83.47% 
for the Minneapolis sample, and that the cut- 
ting line at which the maximum is obtained 
alternates from a point between 2 and 3 in 
the first two studies to between O and 1 for 
the last two studies. Gallese stated that his 
method was more apt to reduce the propor- 
tion of false positives inasmuch as he con- 
tinued to press for a “normal” response if it 
were not at first obtained. He was also more 
liberal in scoring responses in the “normal” 
direction. In the Page et al. study, the spiral 
was revolved in one direction only for three 
trials rather than in two directions for four 
trials. 

The present study, however, does not differ 
from Price and Deabler’s in test administra- 


Table 4 


s for Each Cutting Line in Different 


Percentage of Hit: 
les Assuming a Base Rate of .16 


Hospital Samp 


Percentage of Hits in 
Each Study 
Se 
Price & Page Minne- 


Cutting Lines Between Deabler Gallese ef al. apolis 


Oand 1 


Hp (Positive hit rate) 100.0 43.2 474 
Hy (Negative hit rate) 92.9 91.8 87.9 
Hy (Total hit rate) 93.6 81.0 83.4 
land 2 
Hp 91.5 40.0 
Hy 94.7 88.6 
Hr 94.3 80.8 
2 and 3 
Hp 874 720 * 378 
Hy 98.2 93.6 89.6 
Hr 964 904 79.0 
Hp 3 and 4 = aid 
Hy 99.7 * 91.6 
Hp 95.5, * * 714 


* Data unavailable, 
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tion. The reduction in total hit rate to 83.4% 
(using a cutting line between O and 1) is in 
our opinion largely a result of differences in 
sampling. Our sample was drawn randomly. 
All consecutive admissions who could be 
tested were tested, with exceptions as noted 
above. Furthermore, our patients were prob- 
ably less deteriorated than those selected by 
Price and Deabler though we cannot be cer- 
tain because of the paucity of information 
they provided. We feel that the lack of de- 
scription of their sample represents a very 
serious deficiency in the usefulness of their 
results. It is possible to select samples of 
brain-damaged and psychotic populations such 
that the brain-damaged, being severely de- 
teriorated, can fail almost any task given 
them and the psychotics, being relatively in- 
tact, obtain a high rate of success. Such a 
procedure yields a “mythical population,” 
ie one which does not occur in practice. 
Tests validated on such groups will give de- 
ceptively good discrimination between groups, ( 
only to fail on cross-validation. 
It is perhaps well to note that developing a 

mythical population is not entirely without 
virtue. If the means of obtaining such a sam- 
ple are carefully reported, it may be possible 
to locate or duplicate a reasonably similar 
sample. On the other hand, nonrandomly se- 
lecting a sample may result in one being un- 
able to validly predict what the results might 
be even in one’s own institutional setting 
where the sample was drawn. We can only 
speculate, therefore, as to the nature of the 
differences between the other samples and the 
one drawn for this study. Gallese, for exam- 
ple, reports that the median duration of hos- 
pitalization for his organic group is 65 months 
and for his schizophrenic group 33 months in 
contrast to our groups who were tested an 
average of five days after admission to the 
hospital. There are also substantial differences 
in the percentage of cases of CNS syphilis in 
our samples and those of Gallese, and it is 
probable that this would be the case in a com- 
parison with the Price and Deabler sample. 
The fact that Gallese obtains results inter- 
mediate between ours and thosc of Price and 
Deabler might suggest that he has drawn 
a sample which more closely approximates 
theirs on such significant variables. 
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Table 4 also contains for each cutting line 
the positive hit rate 


(a. = 


and the negative hit rate 


true positives ) 
true positives + false positives 


true negatives 
(as ~ true negatives + false negatives /* 


Thus, in Price and Deabler’s study, 100% of 
cases obtaining a score of 0 are diagnosed as 
cortically damaged, while this is true for only 
43.2% of the Page et al. sample and 47.4% 
of our sample. Conversely, if we wished to 
maximize the negative hit rate, the cutting 
line should be placed between 3 and 4 where 
the rate of correct negative predictions was 
99.7% for the Price and Deabler sample and 
91.6% in our sample. One can, then, select 
a cutting line depending on (a) which sample 
most closely resembles the one in which the 
test is to be used and (b) whether one wishes 
to maximize Hp, Hy, or Hy. 

In most clinics, use of the spiral aftereffect 
as a screening device will be considered in re- 
lation to the efficiency of the instrument as 
well as the kinds of decisions which will be 
made on the basis of positive results, Assum- 
ing that further cross-validation will not cause 
much shrinkage, it might be practical to use 
the test with samples which resemble our 
Psychiatric sample where only 8% false posi- 
tives were obtained with a cutting score be- 
tween 0 and 1. Considering the small amount 
of time and effort involved, it would be fea- 
sible to administer the test to all patients ad- 
mitted to Psychiatry and to recommend a 
neurological workup for those who score be- 
low this cutting line. 

The test would not seem to have utility for 
the screening of Neurology patients. Since 
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there is such an unfavorable ratio between 
valid and false positives it would not appear 
feasible even to advise the neurologist to use 
the test findings as an added weight in his 
diagnostic formulation. 


Summary 


Evaluation of 87 consecutive testable ad- 
missions to the Psychiatry Service and 140 
to the Neurology Service of the Minneapolis 
Veterans Administration Hospital by means 
of the Archimedes Spiral Aftereffect indicated 
that the test had very limited clinical useful- 
ness for detecting pathological cortical brain 
damage. Use of the test did not significantly 
improve the diagnostic efficiency which would 
be obtained by using the base rates. : 

Problems of sampling and criteria were dis- 
cussed. Differences between this study and 
those previously reported appear to be largely 
a function of differences in the samples 
studied. Problems inherent in the use of non- 
random samples for purposes of validation 
were also pointed out. 


Received August 21, 1957. 
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The spiral aftereffect may normally be seen 

when a circular disk supporting an Archi- 

medes spiral is rotated within certain limits 

of speed. During the period of rotation, the 

spiral appears either to expand or to contract, 

depending on both the direction of rotation 

and the direction of the coil of the spiral. 

\ When the rotating movement of the disk is 

interrupted, an aftereffect occurs SO that the 

spiral appears to rotate in the opposite di- 
rection. 

Like many techniques being reactivated in 
current perception research, the spiral after- 
effect has a substantial history- In 1850, Pla- 

| teau, the Belgian scientist, reported the first 
systematic study of the moving spiral. More 
lately, the relation between brightness, direc- 
tion, velocity, etc., and the perception of the 
aftereffect has been investigated (3, 9). 
Along with the interest in the various pa- 
4 rameters of the experience is the attempt to 
relate the performance on the spiral to dis- 
crete mental functions and to brain damage. 
Freeman and Josey’s paper (1) on the corre- 
spondence between memory impairment and 
reduced ability to perceive the aftereffect, 
spurred Price and Deabler (7) to measure the 
relationship between the aftereffect and corti- 
cal damage. The results of this latter effort 
are most impressive in that virtually no over- 
lap in performance was found between a 


group of brain-damaged patients and two con- 


1 Now at Crile VA Hospital, Medical Service. 

2 Now at VA Hospital, Denver. 

3 The authors wish to express their appreciation to 

pen Fagan, graduate student at Pennsylvania 

niversity, and Ted Rice, gradua! 
ern Reserve University, who assist 
evaluating the data. 
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trol groups. In the brain-damaged group 98% 
failed to perceive the aftereffect in each of 
the four consecutive trials, while 95% of the 
nonorganic psychiatric population, and 92.5 o 
of the normal population, were able to per- 
form satisfactorily on each of the four trials. 
In a subsequent paper, Garrett, Price, and 
Deabler (2) repeated their original work with 
40 chronic brain-injured patients. Their find- 
ings substantiate their previous results, inas- 
much as 97.5% of the sample failed to per- 
ceive the aftereffect in each of the four trials. 
Page et al. (6) have provided another test re- 
lating performance on the spiral to cortical 
damage. While their results were in the same 
direction as Price and Deabler’s, the ability 
of the spiral test to discriminate was patently 
less efficient. In another study conducted by 
Smith and Goldberg,* the spiral was adminis- 
tered to normals, psychiatric patients, organ- 
ics, and postshock patients. The test proved 
capable of discriminating between pathologi- 
cal processes and normals, but apparently 
failed to distinguish organic impairment from 
the functional disorders. 

The present study was undertaken to 
cross-validate the findings reported by Price 
and Deabler and particularly the statement, 
“While adequate explanation of the phe- 
nomenon remains to be hypothesized and 
verified, the results are such as to justify 
present clinical ‘use of this technique in diag- 
nosis of organicity (7, p. 302). In addition, 
the following problems were evaluated: (a) 
direction of the coil of the 
and duration of the after- 
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effect, (b) the relation between visual acuity 
and the aftereffect, and (c) the relation be- 
tween the aftereffect and various neurological 
indicia. 

Method 
Subjects 


With the exception of bedfast patients and 
those patients who were too incapacitated to 
‘cooperate, all patients hospitalized during a 
three-month period on a neurological ward in 
a VA hospital were selected for study. Some 
months after the experimental data were col- 
Yected, the patients’ clinical charts were re- 
viewed for information relevant to the follow- 
ing areas: diagnoses,° admission symptoms, 
electroencephalographic (EEG) reports, pneu- 
moencephalographic studies, skull X-ray re- 
ports, findings on spinal fluid examination, 
and reports on visual fields. In certain cases, 
the chart failed to yield data for each vari- 
able. The availability of this type of infor- 
mation was largely a function of each pa- 
tient’s condition and the consequent need for 
laboratory study. 


Apparatus 


A six-inch Archimedes spiral formed in 24 
convolutions was drawn and photographed. 
Two identical spirals were developed, except 
that the second was the photographic rever- 
sal of the first. The two spirals were then 
mounted on two 6-in., circular, metal disks. 
A small metal collar was centered and fas- 
tened to the reverse side of the disks. The 
collar was threaded to complement a machine 
screw which had been fitted to the center post 
of a phonograph turntable. The turntable, to- 
gether with its driving mechanism, was sup- 
ported on an adjustable laboratory stand so 
that the target spiral could be presented at 
eye level to a subject (S) seated at a distance 
of 8 ft. The turntable was activated by a 
78 rpm unidirectional motor. Spiral A seemed 
to expand while rotating and normally would 
be said to contract in the motionless after- 
effect condition. Spiral B, since it was the 
photographic reversal, and since the motor 
was unidirectional, appeared to be contract- 
ing while rotating and to be expanding in the 
motionless aftereffect condition. 


5 All. diagnoses reported in this study were estab- 
lished after weeks of observation and study. 
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In addition to the spiral apparatus, a Snel- 
len chart was used to assess visual acuity. As 
with most work on visual acuity, the minimal 
separable or visual angle was considered the 
invariant. However, since the influence of dis- 
tance is not clearly defined in present-day 
knowledge of visual acuity, it was also con- 
trolled. The size of the room used for testing 
was such that the Ss had to read the chart 
from a distance of 18 ft. By convention, read- 
ings of visual acuity, thus obtained, would be 
adjusted to comply with a 20-ft. distance 
from the chart. Since the distance error 10 
the ratio was constant in this study, it was 
not necessary to make this adjustment. In all 
calculations based on Snellen chart readings, 
the denominator in the ratio was used exclu- 
sively (i.e., with readings such as 18/30 or 
18/20, the computations were performed only 
on the denominators). 


Testing Procedure 


Two experimenters (Zs) were present dur- 
ing all testing. One E typically discussed the 
procedure with S and recorded behavior. The 
second Æ observed and adjusted the appa- 
ratus. The Ss were encouraged to wear glasses. 
When glasses were used, they were required 
throughout the testing. All visual tasks in this 
experimentation were viewed binocularly un- 
der artificial overhead light. 


The patient was told that the tests about to be ad- 
ministered were a special eye examination. The Snel- 
len chart was then called to the patient’s attention. 
He was told to read each succeeding line from left to 
right until interrupted. The score on this task was 
the denominator of the acuity ratio of the most diff- 
cult line read faultlessly. The criterion required that 
the line be read perfectly twice and that the suc- 
ceeding line be faulted twice, The latter condition 
was obviously inapplicable in the case of an error- 
less performance on the entire chart, The Ss were 
prompted to rest their eyes whenever a line was 
failed. 

The spiral task was then introduced. The tw? 
spirals were presented twice each for every S ÍP 
“controlled” random order for a total of four eX- 
posures per S. The order of presentation was thus 
randonized for blocks of six patients: ABAB; ABBA; 
AABB; BBAA; BABA; BAAB. Hereafter, each ° 
the four exposures are referred to as a presentation, 
Between presentations, a cardboard shield was bee 
to cover the apparatus and the S was instructe i 
close his eyes to rest them. Every effort was Be 
to make the interval between presentations unito 


š ary 
both for time and auditory cues. This was necess: 


fa 
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m. order to reduce the extraneous information which 
might be used to anticipate which spiral was being 
readied for the next presentation. 

The instructions for the spiral task were, “Now 
please look at the center of the design on the wheel 
and keep looking right at the center.” At that point, 
the motor which activated the spiral was switched 
on. After 10 seconds, the S was asked to describe 
what he saw. All Ss included in the experimental 
sample were able to describe some form of expand- 
ing or contracting experience while the spiral was 
rotating. The form described depended, of course, on 
which of the two spirals was being used during the 
initial presentation. After thirty seconds of observa- 
tion, the power was cut and the spiral came to rest. 
The average temporal lag between the time the power 
was cut and the time the spiral came to a complete 
stop was 24 seconds. During this interval, S was 
cautioned again to “Keep your eyes on the center 
of the design on the wheel.” After five seconds 
elapsed the S was asked a series of questions in the 
following sequence: (a) What do you see now? (b) 
Does it look different now? (c) Does it look like it’s 
moving now? (d) Does it look like it’s getting larger 
or smaller now? 

The procedure was 
employed by Price an 
was little ambiguity as 
the aftereffect with most Ss” 
testing of the apparatus used in th 
there were many occasions when S’s verbal report 
failed to establish the legitimacy of the aftereffect 
experience. The graduated series of questions was de- 
signed to uncover the essence of S’s perceptual ex- 
perience. A response at any level of questioning which 
indicated that the S experienced a change either in 
direction, size, or in distance was acceptable as long 
as the experience was in the expected direction (ie, 
with a spiral which would normally be seen as con- 
tracting in the aftereffect condition, reports such as 
moving away, increasing distance, or decreasing size 
were all equally correct”). All acceptable responses 
were scored plus. When S’s response for any pres- 
entation was “correct” at any one of the four levels 
of questioning, that presentation was completed. 
Thus, all four levels of questioning were used only 
for responses which were not sufficiently clear to be 
scored with confidence. A response which ultimately 
failed to convince the E that the S perceived the 
aftereffect or which, at any Jevel of questioning, de- 
scribed the movement in the “wrong” direction, was 
scored as a minus performance for that presenta- 
tion. Allowedly, the verbiage employed in the ques- 
tions tended to promote ideation about movement, 
distance, and size. Nevertheless, a “correct” response 
had to incorporate direction of change. In spite of 
the nature of the questions, the direction of change 
had a chance expectancy of two correct guesses in 
four presentations. Accordingly, the S was classified 
as a “Seer” if he scored plus in at least three of the 
four presentations. Ss earning two or more minus 
scores were classified as “Nonseers.” y 

In the case of “Nonseers,” the fourth presentation 


in marked contrast to the one 
d Deabler. They assert “there 
to the presence or absence of 
(7, p. 302). In the pre- 
e present study, 
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completed their performance. The “Seers,” however, 
were asked to continue. The particular spiral used im 
the fourth presentation was retained through four 
additional trials, during which the duration of the 
aitereffect was ascertained. These four duration ex- 
posures will hereafter be referred to as trials. The 
time per trial was recorded in seconds from the in- 
stant the spiral was set into motion, through the 30- 
second exposure period, and up to the moment the 
S indicated that the aftereffect seemed to be extin- 
guished. The directions for these four trials were, 
“Do you remember just a moment ago when we 
stopped the wheel, you told me that the design on 
the wheel looked like it was ‘ ? (the 
subject’s own descriptive phrase was used). Now 
when we start the wheel this time, look at the center 

again and keep looking at it after I stop it. Then 

tell me when the ‘ ? (inserting the 

same phrase again) first stops.” After completing four 

trials, the “Seers” were excused from the test situa- 


tion. 


Results 


The final sample tested numbered 110 pa- 
tients, all of whom were admitted to the hos- 
pital ostensibly for the diagnosis and treat- 
ment of neurological conditions. The mean age 
of the sample was 38.4 years, with an SD of 
10.99 years and a range of 21 to 64. The pri- 
mary diagnoses represented in the sample are 
presented in Table 1 in order to provide some 
notion of the character of the ward popula- 
tion at the time the testing was conducted. 
Of the 110 patients tested, 31 (28%) were 
classified by their performance as “Nonseers.” 
The incidence of “Nonseers” for the various 
diagnoses is also presented in Table 1. 


Comparisons between “Seers” and “Nonseers” 


The means of the ages for the “Seers” and 
“Nonseers” were contrasted, and the lack of 
significance is summarized in Table 2. In or- 
der to compare the means of the Snellen chart 
performances of the “Seers” and “Nonseers,” 
a square root transformation was used since 
the distributions were rather severely skewed. 
The results of this comparison as presented in 
Table 2 were significant (< .01). From this 
finding it may be said that “Nonseers” have 
less acute vision than “Seers” and that this 
relationship does not appear to be related to 


age. 
Comparison of the Two Spirals 


The distributions of duration times for each 
of the two spirals also required normalizing. 


| 
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Table 1 


Diagnoses and Incidence of “Nonseers” 


“Non- “Non- 
Diagnosis N seers” Diagnosis N seers” 
Multiple sclerosis 24 14 Syncope 3 0 
Encephalopathy 15 2 Arteriosclerosis 3 1 
Epilepsy, grand mal 15 2 Intracranial aneurysm 3 1 
Parkinsonism 7 4 Cerebral thrombosis 3 0 
Neurotic reaction 7 0 Alcoholism, chronic 2 0 
Epilepsy, Cephalgia 2 0 
Jacksonian 4 3 Amyotrophic lateral 
psychomotor 4 0 sclerosis 2 0 
idiopathic 3 0 
Note.—There was also one each of the following diagnoses: Muscular dystrophy, migraine, toxic neuropathy,* papillitus optic 


nerve, cerebral embolism,* Friedrich's ataxia, poliomyelitis, progressive spinal muscular atrophy, neuralgia, Huntington's chorea, 
osteoarthritis, transverse myelitis, and schizophrenic reaction, paranoid type.* 


* Denotes a ‘‘Nonseer,” 


Again the square root transformation was em- 
ployed. The results of the comparison of the 
mean duration times obtained on the two 
spirals are presented in Table 3. It is to be 
remembered that the duration trials were 
administered only to “Seers.” Accordingly, 
Spiral B, which normally is seen as expand- 
ing in the motionless Condition, is seen for a 


significantly longer time than is Spiral A 
(< .001). 
Next, the relative difficulty of the two 


spirals was examined. Spiral A (contracting 
aftereffect) yielded 60 failures (27%) out of 
220 exposures. Spiral B yielded 36 failures 
(16%) in a similar number of exposures. 
These percentages were tested by the critical 
ratio formula and proved quite significant 
(< .01). Thus Spiral B (expanding after- 
effect) was appreciably less difficult than 
Spiral A. The performance on the two spirals 
was then distinguishable both for duration 
and difficulty of the aftereffect. The after- 


effect on Spiral B was easier to see and was 
seen for a longer time interval. 


Relation Between Spiral and Clinical Criteria 


The information gathered from the patients’ 
clinical charts was related to the performance 
on the spiral aftereffect. This approach in- 
volved analyzing the chart data on five inde- 
pendent measures, as well as via a global im- 
pression of brain damage. The five indices 
used were EEGs, pneumoencephalograms, 
skull X rays, spinal fluid, and visual fields. 
The global judgments integrated these five 
indices, as well as the admission symptoms 
and the diagnoses into a single, aggregate 
judgment. 

Two judges independently evaluated the 
abstracted chart summaries for each of the 
five indices with 20 of the patients. These 20 
charts were selected in a random manner with 
the one stipulation that information on the 
five indices was available. The judges were in- 


Table 2 


Age and Visual Acuity in “Seers” and “Nonseers” 


Mean scores SD 
“Non- “Non- 
Variable “Seers” seers” “Seers” seers” t $p 
; 37.71 40.26 10.41 12.35 1.00 = 
a casts 4.4871 5.9007 1.3021 2.4707 2.98 <.01 
‘isua 


a Norialized via a square root transformation. 
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Table 3 


Comparison of Duration Time® on Spirals A and B 


Spiral N Mean SD t ? 
A 152 6.3861 6001 6.2969 <.001 
B 163b 6.8879 ~—«.8018 


à Normalized via a square root transformation. 
One patient failed to perceive the aftereffect on one of the 


duration trials on Spiral B. 


structed to assign each case to one of the 
three categories: obvious brain damage, ques- 
tionable brain damage, or no evidence of brain 
damage for each variable (EEG, etc.). The 
two judges agreed perfectly on 84% of the 
ratings. With this degree of consistency, it 
was possible to use the judgments of a single 
judge for the purpose of relating the five in- 
dices to the spiral performance. Whenever 
data were not available, the patient was ex- 
cluded from the analysis on that particular 
index. The contingency coefficients between 
the spiral performance and the neurological 
measures, as well as the levels of significance, 
are presented in Table 4. Only chance asso- 
ciation was demonstrated between the per- 
formance on the spiral test and the three 
clinical variables: EEGs, pneumoencephalo- 
grams, and skull X rays. However, in the case 
of the visual field examinations and the spiral 
fluid, significant correlations (both < .05) 
were obtained with the performance in the 
aftereffect situation. The global estimate of 
cortical damage was made by one of the au- 
thors. The contingency coefficients along with 
the level of significance (< .05) are also pre- 
sented in Table 4. 


Discussion 
When certain stimulus patterns are ob- 
d in motion at critical speeds, the ac- 
r to continue for some ap- 
preciable time after the objective motion 
ceases. Such experience is often termed mo- 
tion afterimage. The spiral aftereffect is a 
form of subjective motion afterimage, com- 
plicated by a negative experience of changing 
size or depth. As such, it incorporates radial 
movement, apparent movement toward or 
away from an observer, and gamma movè- 


6 These judgments were made b; 
his project. 
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ment, another form of apparent movement 
usually associated with a swelling of the size 
of a suddenly illuminated stimulus. 


The Spiral Aftereffect as a Clinical Tool 


The results of the present study tend to 
confirm the general usefulness of the spiral 
aftereffect as a heuristic laboratory technique 
for studying brain pathology. There is, how- 
ever, some real question about the propriety 
of the technique in clinical practice. The 
spiral task as explored in the present study 
does not appear to live up to the claims made 
for it by Price and Deabler as an individual 
diagnostic measure. 

The critical need in clinical practice is for 
a technique sufficiently valid to be utilized 
with ambiguous and difficult problems in the 
diagnosis of brain damage. When perform- 
ance on the spiral was compared with pa- 
tients’ diagnosis in the present study, the 
efficacy of the aftereffect as an individual 
diagnostic instrument seemed dubious. The 
disparities between the results in the studies 
by Price and Deabler and the present work 
may be attributable to many factors. For one 
thing, the degree of obviousness of brain dys- 
function in the organic samples tested may 
have been at variance. In addition, some very 
real differences in methodology were em- 
ployed. The scoring scheme in the present 
study made no distinction between verbal re- 
ports of changes in size and depth. In the 
study by Price and Deabler, size changes 
were given greater recognition in scoring. The 
justification for each specialization in scoring 
was not apparent to the present authors and, 
consequently, any response which indicated 


Table 4 
Performance on the Spiral Task 


Relationship Between 
sear aS rire ] Neurological Tests 


and Clinica 
Contingency Signifi- 
Variable coefficient cance 
EEG wld — 
Pneumoencephalogram .03 = 
Skull X ray 05 — 
Spinal fluid .24 .05 
Visual fields 27 .05 
25 05 


Global analysis 
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an appreciation of negative perceptual experi- 
ence was fully accredited. In addition, the in- 
tention in the present study was to provide 
S with every chance to report an experience 
which may normally appear somewhat freak- 
ish and unnatural. Such an experience, it was 
reasoned, might be rather difficult to verbal- 
ize. Frequently it was found that Ss did quite 
well on the task only after they fully under- 
stood the inquiry. At times this required the 
complete battery of four questions in order to 
elicit a satisfactory report. It is suggested that 
some of the inability of the organically im- 
paired to report the aftereffect in Price and 
Deabler’s paper may have been in part a con- 
Sequence of communication failure rather than 
Perception failure. 


age. The need 


study of Perceptual processes is discussed by 
Yates (10) w 


sion of 
velopment 
age. Thi 


: c pt to explore further 
the relationship between visual acuity and 


brain damage, the Snellen chart readings were 
contrasted in the three groups differentiated 
in the global neurological appraisal, No rela- 
tionship was found between these estimates of 
brain damage and visual acuity. The question 
as to the nature of the relationship between 
visual acuity and performance on the spiral 
must come under closer scrutiny before the 
technique can be used with confidence in 
clinical practice. 


The Comparison of the Two Spirals 


The performance on the two spirals indi- 
cates that the level of difficulty in perceiving 
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the aftereffect,as well as the length of the 
aftereffect, was quite distinct. One of the best 
documented facts about the perseveration of 
movement afterimage is its dependence upon 
the velocity of the revolving stimulus. How- 
ever, this factor was controlled in the present 
study, except for changes in line voltage which 
should have affected both spirals without bias. 
The finding that a spiral which seems to be 
expanding has a longer period of after-activity 
is consistent with observations of duration in 
gamma movement studies. In the latter stud- 
ies, the expansion phenomenon, which occurs 
when a light source is introduced in a visual 
field, has been contrasted with the shrinkage 
which is reported when the light is dimmed or 
extinguished. As in the observations on the 
two spirals, the spreading movement occupies 
a significantly longer time interval than the 
shrinking movement. The two spirals were 
also compared to determine if they were 
equally effective in differentiating cortical 
damage as determined by the global clinical 
judgments. In spite of the fact that Spiral A 
elicited a greater absolute number of failures, 
there was no difference in efficiency of the 
two spirals in detecting brain damage. 


The Spiral A ftereffect and Vision 


The degree of relationship between the 
spiral Performance and clinical visual tests 
inspired conjecture about the possible connec- 


tion between deficit on the spiral task and in- 
Jury to areas of the o 


that the task 


he presumed dam- 
e level of reliability for these 
d unsatisfactory, and the ef- 
ned for the present paper. 

in this study suggested rather 
Wo somewhat antagonistic as- 
functioning were simultane- 
ously impaired in “Nonseers.” On the one 
hand the ability of the “Nonseers” to make 
fine visual discriminations (visual acuity) 
Was notably lessened. Such a function, ac- 
Cording to various theories of vision, should 


age. However, th 
judgments prove 
fort was abando: 

The evidence 


pects of visual 
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require a high degree of insulation among 
juxtaposed individual pathways as well as a 
great number and superior differentiation of 
retinal receptors. The aftereffect task, on the 
other hand, would require either centrally or 
in the peripheral system rather complex neural 
interaction., Thus the dual failure of “Non- 
seers” on visual acuity and spiral aftereffect 
tasks provides concurrent behavioral evidence 
of deficit in anatomical insulation and physio- 
logical interaction. 


Conclusions 


The purpose of this study was to evaluate 
the use of the spiral aftereffect as an index 
of brain damage in a neurological setting. In 
addition, certain neurological specifications of 
organic impairment were employed as criteria 
against which perceptual experience was meas- 
ured. And, finally, the direction of the coil of 
the spiral was varied, and the visual acuity 
of the subjects was tested in order to evaluate 
their effect upon performance. The results are 
as follows: 


1. Of a sample of 110 patients admitted to 
a neurological ward, 28% were unable to per- 
form satisfactorily on the spiral task. | 

2. Those who performed satisfactorily on 
the spiral task had significantly better visual 
acuity as measured by Snellen chart perform- 
ance, but were not distinguishable in age from 
those whose performance on the spiral task 
was considered unsatisfactory- 

3. Whether the aftereffect too 
expansion or contraction was i 
the ease with which it was repor 
as for the length of time it was SU 
perceived. 

4. Performance on the spiral 
spinal fluid examinations, visua 
and global judgments of the lik 


k the form of 
mportant for 
ted, as well 
bjectively 


was related to 
] field studies, 
elihood of 


255 


brain damage. Performance on the spiral was 
not related to EEG reports, pneumoencepha- 
lographic studies, or skull X-ray reports. 
The degree of relationship demonstrated be- 
tween estimated brain damage and spiral per- 
formance was taken as vindicating further ex- 
ploration of the technique. It was suggested, 
however, that caution be exercised in the clini- 
cal use of the test, particularly in those situa- 
tions in which the demand for such a test 
would be the most imperative, i.e., in the 
evaluation of individual cases where the diag- 
nosis is less than straight-forward and direct. 


Received August 5, 1957. 
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A Further Study of the Perception of Apparent 
Motion by Schizophtenics 


Rayford T. Saucer 
VA Hospital, Perry Point, M. aryland 


The Perception of visual apparent move- 
ment in normal subjects has been widely 


single light which swings smoothly back and 
forth. This State is known as optimal move- 
ment or beta movement (5). If the fr 
of alternation is again raised 


a much higher rate than organics, 

They also found that a Stroup of undiffer- 
entiated schizophrenics showed some degree 
of impairment in the ability to perceive opti- 
mal movement, although a Stroup of loboto- 
mized schizophrenics showed no measurable 
deficit. The present Paper is a report of an 
experiment designed to further explore the 
loss of ability to perceive optimal movement 
in schizophrenic individuals, 


The apparatus used in this study was a low fre- 
quency, square-wave generator, with a Hayden mo- 
tor sweeping from 2.5 to 10 cycles per second jn 


three minutes, The square-wave generator gated two 
Sylvania R1130B glow modulator tubes 180° out of 
Phase. A green “Dialite” fresnel lens (No. 34-841) 
was placed over the end of the R1130B tube. The 


Subjects and Method 


Subjects (Ss) were 21 undifferentiated 
schizophrenics, 21 paranoid schizophrenics, 
and 10 control Ss. The Patients were drawn 


Personnel. Patients were selected by ward 
Psychiatrists and their diagnosis made known 
after they were tested. 


at an alternation frequency of 2.5 
cycles per second and the 


; Teport any changes in the 
Ss immediately reported “it’s getting 


faster,” but a simple “yes? seemed to be an ade- 
quate explanation, 


Score was given, 
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Results 


The rate at which omega movement ap- 
peared was taken as the rate at which optimal 
movement had ceased. The mean rates and 
their associated standard deviations are given 
in Table 1. 

The results are presented in Table 2 in 
terms of ¢ and the Mann-Whitney U sta- 
tistic (6, pp. 116-127). Although the differ- 
ences between the schizophrenic group and 
the paranoid and control groups are statisti- 
cally significant on the basis of the computed 
t, nonparametric analysis was also carried 
out because (a) it is evident that the variance 
is correlated with the mean, and (b) nothing 
is known concerning the population distribu- 
tion of omega thresholds. The Mann-Whitney 
x/sigma values are equal to critical ratios 
when W is sufficiently large and hence may 
be interpreted by reference to a table of 


Table 1 
Threshold Means and Standard Deviations of Groups 


Group Mean SD 
Schizophrenic 3.428 .766 
Control 5.15 1.39 
Paranoid 5.417 1.96 


x/sigma for a normal distribution. It can be 
seen that the values are sufficiently large to 
allow the null hypothesis of no true difference 
between the schizophrenic group and the con- 
trol and paranoid groups to be rejected at a 
Comfortable level of significance. 

Since the statistical analysis does not clearly 
show the degree of overlapping between the 
different categories, an analysis by approxi- 
mate quartiles is given in Table 3. It can be 
seen from this table that whereas the ma- 
jority of the schizophrenics are below the cut- 
ting score of 4.130 cycles per second, the 
larger part of the paranoid Ss tested fall into 
the higher quartile ranges. If we wager that 
all scores below the median belong to schizo- 
phrenics and all high scores to paranoids, then 
we shall be correct in 33 cases out of 42. If 
we make the same wager for the normal- 
schizophrenic grouping, we shall be correct in 
25 cases out of 31. The associated percent- 


ages of correct prediction are 78.5% for the 
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Table 2 
Significance of Mean and Rank Differences 
Signifi- Signifi- 
Groups compared t cance x/sigma cance 
Schizophrenic- 

Control 3.67 -001 3.80 00009 
Paranoid-Control NS NS 
Schizophrenic- 

Paranoid 4.35 .001 3.91 -00005 


schizophrenic-paranoid group and 80% for 
the schizophrenic-normal group where 50% 
correct predictions can be made by change 
alone. 

Discussion 


The primary hypothesis of a difference in 
apparent motion perception between normal 
and undifferentiated schizophrenics seems to 
be tenable. The fact that these differences are 
more marked in this experiment than in the 
earlier experiment (5) may be due to the in- 
crease in sample size. The combined findings 
from the two experiments suggest that there 
is a noticeable deficit in the perception of 
optimal movement by the schizophrenic. 

Since the results of the experimental pro- 
cedure do agree reasonably well with the pres- 
ence or absence of schizophrenia as estab- 
lished by other diagnostic criteria, the use of 
apparent motion perception as an added diag- 
nostic procedure seems warranted. At the 
same time, due to the use of relatively com- 
plex electronic test equipment, the method 
seems more useful in connection with research 
procedures than as a routine diagnostic test. 

The evidence concerning the “normal” per- 
ception of apparent movement in the paranoid 
schizophrenic is of considerable interest and 


Table 3 
Distribution by Cutting Scores 


Schizo- Para- 
Cutting score phrenics noids Controls N 
2.50-3.375 10 4 
3.38-4.125 8 2 r, 3 
4.130-4.875 3 5 2 10 
4.88-12.00 0 10 5 15 
Total 21 21 10 52 
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ence of an entirely different pathology. It has 
been argued earlier (5) that the ability to 


Organizations. The en- 
become Circular in nature 


Thus, the first Stages of the 
be characterized by hyper- 


components in the paranoid individual may 
be viewed as a Consequence of genetic acci- 
dent plus the personal and Private emotional 
problems acting together in a reactive rather 
than in a process fashion to produce such be- 
havior. 

It is likely that a long range study of para- 
noid schizophrenics would show that in the 


Rayford T. Saucer 


early stages of development they would show 
hypernormal ability to organize perceptual 
Processes. In spite of behavioral pathology, 
they would not show “schizophrenic” deficit 
in this area, During the later course of the 
a decline in organizational ability 
accompanied by an increase in 
schizoid symptoms until finally the two pa- 


Summary 

Earlier evidence has indicated that schizo- 
phrenics may show impaired ability to per- 
ceive visual apparent movement. This paper 
is a report of an experiment designed to ex- 
plore the degree of impairment in a large sam- 

ple of schizophrenics, 
here are Statistically significant differ- 
ences between the i 
phrenic group and the contro] group but not 


It is concluded that apparent visual move- 
ment thresholds may be a useful diagnostic 
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Success and Failure in Client-Centered Therapy As a 
Function of Client Personality Variables’ 


William L. Kirtner and Desmond S. Cartwright 


University of Chicago 


Cartwright (5) has presented evidence for 
the existence of a “failure-zone,” ranging be- 
tween 13 and 21 interviews, in client-cen- 
tered therapy. In a subsequent paper, Taylor 
(25) presented closely comparable evidence 
with respect to psychoanalytically oriented 
psychotherapy. 

Cartwright demonstrated that therapeutic 
outcomes were divided by the failure-zone 
and suggested that there may be two forms 
of therapeutic process, identifying these proc- 
esses as “short” (1-12 interviews) and “long” 
(13-77 or more interviews). He further hy- 
pothesized (5, p. 362) “that certain indi- 
vidual differences between clients give rise to 
different kinds of therapeutic process.” 

On the basis of these results and hypothe- 


ses, five client groups were distinguished: 


short success, 1-12 interviews; short failure, 
13-21 inter- 


1-12 interviews; failure-zone, +9- i 
views; long success, more than 21 interviews; 
and long failure, more than 21 interviews. 
Utilizing this schema, Kirtner (12) hypothe- 
sized that therapy length-by-outcome 1S re- 
lated to the personality structures of clients 
at the beginning of therapy. The present pa- 
per reports an investigation of this hypothesis. 


Method and Procedure 
Subjects 


From the research files of the Counseling 
Center, University of Chicago, all clients were 
selected for whom the following four condi- 


1This investigation is based upon a dissertation 
submitted by the senior author to the University of 
Chicago in partial fulfillment of the requirements for 
the degree of master of arts. It was supported in 
part by research grants from the National Institute 
of Mental Health, National Institutes of Health, 
U. S. Public Health Service, and from the Ford 


Foundation. 


tions held: (a) the therapists’ rating of out- 
come on a 9-point success rating scale (22) 
fell either between 7 and 9 inclusive (“suc- 
cess”) or between 1 and 4 inclusive (“fail- 
ure”); (b) the exact number of interviews 
was recorded; (c) a pretherapy Thematic 
Apperception Test (TAT) protocol was avail- 
able; and (d) a recorded or transcribed first 
therapy interview was available. Twenty-four 
clients fulfilled all conditions. Two clients who 
fulfilled conditions (a), (b), and (c), but 
not (d), were also included, yielding = 26 
for this study. All clients were seen by ex- 
perienced therapists (25 male and 1 female) 
between 1949 and 1954. The sample included 
12 males, 14 females; 10 students, 16 non- 
students; the mean age was 27.5 years and 


the range 19 to 41 years. 


Instruments 

Rating scales were developed to measure 
twelve personality variables. These variables 
were selected to comprehend: (a) some of 
those variables widely referred to as desig- 
nating level or pattern of personality integra- 
tion, e.g., Sex role and identification, motiva- 
tion, impulse life; (b) some of those variables 
particularly relevant to the phenomenological 
basis of client-centered therapy, e.g., decision- 
making, rule usage, sense of self as a causa- 
tive agent (16; 17, pp. 4-5); and (c) some 
of those variables especially associated with 
previous research in client-centered therapy, 
e.g., sensitivity to others (23, 24, 26), intra- 
punitive feelings (9). Upon analysis of the re- 
sults derived from the application of the 12 
scales, 6 scales were eliminated due to func- 
tional overlap with the remainder. Numerical 
ratings made by an independent judge on the 
12 scales were intercorrelated. The resulting 
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matrix was inspected for clusters from each 
of which one scale was selected, yielding four 
relatively independent scales, numbered I, 
IV, X, and XI. Scale VIII, while substan- 
tially correlated with Scale I, was uncorre- 
lated with the other three selected scales and 
is therefore reported upon. Scale XII, highly 
correlated with Scale XI on numerical rat- 
ings, is also reported upon because of its 
distinctive qualitative differentiation between 
clients. Over the six scales, the range of inter- 
correlations was — .24 to .77. The median 
correlation was .29. 

Following are brief descriptions of the six 
scales reported in this study. In complete 
form, all are 5-point, fully anchored scales.? 
A rating of 1 indicates minimal disturbance 
(optimal adjustment), and a rating of 5 in- 
dicates maximal disturbance. 

Scale I—Impulse Life 


From free flow and expression 


€ of generative im- 
pulses and ideas, to extreme: 


a. fright about impulses but will 


b. control or Tepression ; 
¢. distortion of impulses, 


se IV—Sense of Capability 
rom a sense of felt ca acity t 
will eine Pacity to cope adequately 


ions, to a sense of helplessn. 
internal re. ith sit 


h expression $ 


Scale X—People—Object Orientation 
From the ab 


ility to relate deep! both to people 
and in activities, to: 7 ge 


a. a desperate need for People; 
b. avoidance of relatin; 

comitant desperate ni 
c. immobilization, 


Scale XI—Sense of Comfort and Satisfaction 

From a sense of self-comfort and satisfaction with 
the ability to locate problem sources both internally 
and externally in good balance, to: 


a. intensely driven to search himself for causes 
of discomfort and dissatisfaction b 

b. intensely driven to search outward for causes 
of discomfort and dissatisfaction -i 

c. intense hopelessness to locate causes, 


2 Copies of the complete scales and of the raw 
data from both judges may be obtained without 
charge from William L. Kirtner, Counseling Center, 
University of Chicago, 5737 Drexel Avenue, Chicago 
37, Illinois, or for a fee from the American Docu- 
mentation Institute. Order Document No. 5585, re- 
mitting $1.75 for microfilm or $2.50 for photocopies. 


William L. Kirtner and Desmond S. Cartwright 


Scale XII—Punitive Feelings 


From a self-appraising person who is not self- 
reproachful, to: 


a. extremely self-punishing person; 

b. extreme anticipation of punishment from ex- 
ternal source; 

c. vacillation between “a” and “b.” 


It will be noted that some of the scales in- 
clude alternate descriptive anchors, indicated 
by letters a, b, c. Such letter ratings occur 
only in connection with numerical ratings of 
3 or more. As the level of disturbance in- 
creases in a given area (as the numerical rat- 
ing is higher on these scales), the behavior 
displayed may take on one of several modal 
characteristics. Salient nonreactive, explosive, 
or other features of behavior become usual 
and representatively distinguishing attributes 
of the person rated. Such salient character- 
istics or modal patterns of behavior must be 
discretely described in order to obtain a fully 
anchored scale of levels of disturbance. As the 
level of disturbance decreases (as the nu- 
merical rating is lower on these scales), the 
behaviors displayed do not require multiple 
discrete descriptions; salient nonreactive, ex- 
plosive, or other features of behavior are 
neither usual nor representatively distinguish- 
ing attributes of the person rated. 

While the foregoing paragraph presents the 
descriptive (i.e., scale-making) problem, the 
existence of the problem invites explanation. 
The authors hold the working hypothesis that 
the individual adopts certain specifiable modes 
or techniques of behavior in order to control 
his internal disturbance or anxiety with re- 
spect to a given Segment of his experience. 
As anxiety or disturbance intensifies, the tech- 
niques required for control of the disturb- 
ance, or for maintenance of personality or- 
Sanization, become More drastic and more 
representatively typical of the individual. 


Ratings 


Ratings of each client, on each of the six 
scales, were made on the basis of the pre- 
therapy TAT Protocol in conjunction with 
the recorded or transcribed first therapy ye 
terview. In two cases, the recorded first in- 
terview was not available, and the TAT pro- 
tocol alone was used. 

Ratings were made independently by the 


. 
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senior author and by another judge. The lat- 
; 3 

ter (“Judge II”) knew neither the length nor 

the success rating of any case. 


Reliability 


Reliability of the therapist rating of out- 
come on the 9-point scale has been previously 
reported (5, 22) as slightly better than 7 = 
.80. To determine reliability for the numeri- 
cal ratings on the six scales, all ratings by 
the two independent judges were correlated 
using Kendall’s tau for ties in both rank- 
ings (10). The computational procedure em- 
ployed was that developed by Cartwright 
(3). Corrections for continuity were made 
using Schaeffer and Levitt’s (21) modifica- 
tion of Whitfield’s correction (27). The rou- 
tine for computing corrections for continuity 
and p values was that described by Cart- 
wright (4). Table 1 presents these reliabil- 
ity data, which were considered adequate 
throughout. 

Letter ratings occurred on four out of the 
six scales. Since such ratings are associated 
only with numerical ratings of 3 or more on 
these scales, a long and tedious problem in 
combinatorics would have to be solved to ob- 
tain an exact estimate of reliability, which 
did not seem justifiable. A fortiori, it did not 
seem justifiable to work on a solution for the 
reliability of joint numerical-plus-letter rat- 
ings. Instead, simple percentages of agree- 
ment were computed for all cases where both 
judges employed a letter rating, and regard- 
less of numerical rating. Table 2 presents 
these data and includes, for the reader’s in- 
formation, the number of cases where neither 
judge used a letter rating. 

No statistical analysis of results from let- 


Table 1 


Reliability Coefficients (Tau) for Numerical 
Ratings on Six Scales 


Scale Tau p 

I. Impulse life 65 01 
IV. Sense of capability 62 01 
VIII. Sex-role and identification 53 1 
X. People-object orientation .13 .01 
XI. Sense of comfort and satisfaction ms T 


XII. Punitive feelings 
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Table 2 


Percentages of Agreement for Letter Ratings on 
Four Scales 


Number of cases for 
which letter ratings 
were used by 


i Agreements 

Neither Both 
Scale judge judges Number % 
E 3 22 20 91 
X. 0 26 23 88 
XI. 0 26 25 96 
XII. 1 25 22 88 


ter ratings was made. However, the authors 
judge the data of Table 2 to warrant descrip- 
tive characterization of modal behaviors dis- 
played by subjects rated on the four scales 


referred to. 


Analysis 

The sample of 26 cases was divided into 
length-by-outcome groups according to the 
schema given. Table 3 summarizes descrip- 
tions of the resulting groups. 

Regrettably for the research, only one long- 
failure case was among those available. This 
group was therefore eliminated from subse- 
quent analysis. The remaining groups were 
examined in all possible pairs on each of the 
six scales as numerically rated by Judge II. 
All comparisons were made using tau for a 
dichotomy in one ranking as described by 
Kendall (10, pp. 32-34). The significance of 
differences between groups was computed in 
the manner previously indicated for the reli- 
ability analysis. In order to show the direc- 
tion of differences between pairs of groups, 
mean values for each group on each scale 
were also computed. 


Results 


Numerical Ratings 


Table 4 presents means for groups on each 
of the six scales and the p values of the dif- 
ferences between groups.” 

Rejecting the null hypothesis if p < .05, 
each success group shows a lesser degree of 


3 See Footnote 2. . 
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Table 3 
Summary Description of Groups 

Number of Range of out- Non- 

Group interviews come ratings N Male Female Student student 
Short failures <13 14 10 4 6 4 6 
Short success <13 7-9 4 0 4 3 1 
Failure-zone 13-21 14 7 5 2 1 6 
Long failure >21 14 1 1 0 1 0 
Long success >21 7-9 4 2 2 2 2 


:10. On this basis, Table 4 embodiment in descri 


ws more disturbance than clear qualitati 
n Scale IV; and the failure- The short-success 


presents the number of letter rat- uncertainty, they a 


differences in typical mode of controlling 
short-success 8roup shows inner disturbance were observed by both 
judges. 


are results setting a Distinguishing Descriptions i 
The results and observations mentioned in 
null hypotheses if in connection with Tables 4 and 5 are given 
ptions distinguishing the 
groups. Descriptions employ the language of 
ess disturbance than any those scales, and only those scales, for which 


; the short- either statistically significant differences or 
ve observations have been made. 


re a good deal less con- 


by both judges for four fused about their sex role than other groups 


ur groups. (VIII) 


? of Differencesa 


Scale SIS sF m g Ws LS SSvs.SF SSys, Fz I5 vs. SF LS vs. FZ SF vs. FZ 
I 2.00 3.00 4.10 443 ac om 
: f <.01 >.20 
IV. 3.00 3.25 430 37 >% <p [i <9 <ù >a 
VII. 2.50 3.75 380 4'57 <07 zü 220 a 
x He He im =o >d å >d S% 52 S20 >20 
XL I5 4 : P b a j : 2a 
RN 3.25 425 380 385 >.20 >.20 <.08 


S19 s2 S00 >20 >20 >.20 


è Two-tailed tests throughout. 


b SS—short success; LS—long success; SF—short failure; FZ—failure-zone. 


o> 


TES Q 


vw 


Table 5 
Letter Ratings Agreed on by Both Judges 


Failure 
zone 


Short 
failure 


Short 
success 


Long 
success 


abe abe abe abe 


4 234 S tl 

= 4 4 i@s4 242 
XI 3 4 $ 2 6 1 
XU. 3 4 81 41 


and rather confused about the meaning and 
place of sex in their identity (VIII). 

Both success groups differ from each failure 
group in showing less disturbance in their im- 
pulse life (I). Letter ratings show the success 
groups typically displaying a strong need for 
people to relate to in order to feel worthwhile 
(X), seeking internally for the cause and 
resolution of felt discomfort (XI), and rather 
strongly condemning, berating, and disvalu- 
ing themselves (XII). 

The short-failure group shows a generally 
low level of personality integration. Especially 
distinguishing is their extreme underlying 
sense of incapacity to deal with their life 
situations (IV). 

The failure-zone group also shows a gener- 
ally low level of personality integration. Es- 
pecially distinguishing is their extreme con- 
flictedness about and rejec 
role (VIII). ' 

Both failure groups show greater disturb- 
ance than either success group OR several 
scales. They are extremely disturbed in their 
impulse life (1), with expressions frequently 
occurring in over-controlled or distorted mo- 
dalities, as indicated by letter ratings. Over- 
control seems somewhat more typical for the 
failure-zone group. Letter ratings show the 
failure groups typically looking outward for 
the cause and resolution of their discomfort 
(XI), and typically anticipating punishment 
from external sources (XII). 


tion of their sex 


Discussion 


The foregoing results seem unambiguously 
consistent with the general hypothesis moti- 
vating the study: that therapy length-by-out- 
come is related to the personality structure of 
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clients at the beginning of therapy. While 
caution must be invoked due to the small 
sizes of the groups studied, the results add to 
the growing body of knowledge about factors 
which favor or limit therapeutic change in 
client-centered therapy. Earlier work in this 
area has been summarized by Rogers (17, pp. 
423-424, 427-428). 

It may be noted that the present approach 
constitutes a synthesis of two trends in previ- 
ous work on the general problem. One trend 
has dealt with the relations between prether- 
apy characteristics of clients and eventual 
ratings of improvement or outcome (e.g., 1, 
2, 8, 11, 15, 19, 26). The other trend has 
dealt with the relations between pretherapy 
characteristics of clients and their length of 
stay in treatment (e.g., 7, 13, 14, 18, 20). 
To our knowledge, only one previous investi- 
gator, Dana (6), has attempted to predict im- 
provement and length of treatment jointly. 
Due to the findings of Cartwright (5) and 
Taylor (25), a fusion of the two main trends 
into systematic emphasis upon length-by-out- 
come groupings now seems necessary. More 
generally, it is necessary to predict both 
amount and rate of change constituting 1m- 
provement. While something of a beginning 
has been made in this direction by Dana’s re- 
sults and by those of the present study, much 
more needs to be done. 


Summary 


Twenty-six clients, who had completed a 
course of client-centered therapy at the Coun- 
seling Center, University of Chicago, were 
divided into five groups on the basis of length- 
by-outcome: 

Short success (1-12 interviews) —N equals 4 
Short failure (1-12 interviews)—N equals 10 
Failure-zone (13-21 interviews) —N equals 7 
Long success (more than 21 interviews) —V 


equals 4 
Long failure (more than 21 interviews)—N 


equals 1 


Twelve personality variables were selected, 
and 5-point rating scales were constructed to 
describe both intensity and mode of behav- 
ior with respect to each of the 12 variables. 
These scales were applied independently by 
two judges to the pretherapy Thematic Ap- 
perception Test protocol in conjunction with 
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the recorded or transcribed first therapy in- 
terview in each case. Interjudge agreement 
was deemed adequate throughout. 

The ratings made by an independent judge 
were intercorrelated, and the resulting matrix 
was inspected for clusters from each of which 
one scale was selected, yielding four relatively 
independent scales. Two further scales were 
reported upon because, though substantially 
correlated with one of the four selected scales, 
they are uncorrelated with the others and 
point up interesting and distinctive differ- 
ences between client Personality structure. 


It was thus found that therapy length-by- 
outcome is related to the pe 
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As a technique for producing changes in the 
personality structure of a patient, psycho- 
therapy does not exist apart from the person 
of the therapist. While it is axiomatic that the 
therapeutic instrument comprises the thera- 
pist, his personality, theory, and techniques, 
little systematic attention has been paid by 
researchers to these variables. 

In a sense, the therapist is a reader of im- 
aginary dials who acts “therapeutically” upon 
the information indicated by these measuring 
instruments within himself. When supplied 
with certain information, say, the behavior 
of a patient, he will register this information 
in certain ways, and he will react to it in cer- 
tain other ways. The therapist’s theory, ex- 
perience, and personality determine the kinds 
of dials he uses as well as their calibration. 
His therapeutic actions are their reflection. 

In order to obtain empirical data on the 
calibration of the therapist as 2 clinical in- 
strument, we can supply 4 certain identical 
input (patient behavior) and note (a) how 
this input is perceived and evaluated; (b) 
what deductions and inferences are drawn 
from it; and (c) how these processes are 
translated into therapeutic action. On the hy- 
pothesis that this testing procedure will dis- 
close differences among therapists, one can 


1 This paper was presented at the 1957 meeting of 
the Eastern Psychological Association. 
This research, part of a larger project supported 
by a research grant (M-965) from the National In- 
ental Health, Public Health Service, was 


conducted while the author was affiliated with The 
iversity, School of Medicine. 


investigate systematic influences which might 
produce the discrepancies. For example, thera- 
pists may use different sets of measuring in- 
struments whose readings have no relation to 
each other. They may use similar instruments, 
but the calibration may differ. They may in- 
terpret differentially the meaning of the same 
pointer reading. Any one of these possibili- 
ties, plus many others, may result in divergent 
therapeutic communications. 

This analogy is of course a gross oversim- 
plification of the therapist’s activity in the 
therapeutic situation, but it may help to make 
explicit the objectives of the larger investiga- 
tion of which this paper forms a part. The 
purpose was to study the therapist's perform- 
ance in a first interview and to ask: If a 
group of therapists observe the same patient, 
how do they perceive the clinical problem? 
What kinds of evaluations result from their 
perceptions? How are their perceptions and 
evaluations related to their communications? 
And, can differences in their performance be 
accounted for in terms of common underlying 
variables? Specifically, this paper is concerned 
with a comparison between psychotherapists 
(psychologists) following psychoanalytic prin- 
ciples and therapists following the client-cen- 
tered theory of Rogers. 


Method and Procedure 


To study the performance of psychothera- 
pists under comparable conditions, a sound 
film of a first interview was used as an ex- 
perimental model. The film was produced by 
the Veterans Administration for training pur- 
poses and was entitled “A Clinical Picture of 
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Claustrophobia.” * It was described as an un- 
rehearsed interview from which no significant 
portions had been deleted. The motion pic- 
ture was adapted for experimental purposes 
by introducing interruptions at 28 preselected 
points identified by a uniform title “What 
would you do?” followed by a number from 
1 to 28. 


Synopsis. The patient, a middle-aged man, com- 
plains of intense anxiety and gastrointestinal symp- 
toms which appear to be psychogenic. He relates an 
episode of a panic reaction on a crowded street car, 
Following the incident he found himself unable to go 
out of the house unless he was accompanied by his 
wife, an invalid of many years. As the interview 
progresses, he dwells on an intense conflict with his 
mother, a strong-willed wom, 
about his “bad luck” i 


the patient was young, leaving 
he was 


rather distant, He was 
ance and seemed ill at 
about the outcome of th 


no reassur- 
ease. No clues were given 
e interview, 

The film was shown to groups of therapists 
who were asked to assume that they were in- 
terviewing the patient, and to record in writ- 
ing their communications to the Patient while 
the film sequence was interrupted. Each Pause 
lasted 30 seconds, which Provided most thera- 
pists ample but not excessive time to make 


3 The “Psychotherapeutic Interviewing Series” was 
directed by Jacob Finesinger and Florence Powder- 
maker. The film under discussion, Part V of the se- 
ries, was filmed‘in 1952. I wish to express my ap- 
preciation to the Psychiatry and Neurology Service 
of the Veterans Administration for granting permis- 
sion to.use the film for experimental Purposes, 
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their comments. Respondents were free to re- 
spond or to remain “silent.” The experimental 
version of the film ran continuously and lasted 
approximately 50 minutes, 

Following the film showing, therapists were 
requested to complete a comprehensive ques- 
tionnaire on diagnostic impressions, treatment 
plans and goals, formulations of the patient’s 
emotional dynamics, problems in treatment, 
estimates of the degree of anxiety, emotional 
maturity, social adjustment, Prognosis, the 
Tespondent’s attitude toward the patient, etc, 
In addition, there was a biographical infor- 
mation blank containing 24 questions about 
the therapist’s training, theoretical orienta- 
tion, and current therapeutic activities, 

The experimental Procedure usually re- 
quired about two hours. 


The Samples 
Cooperation w. 
and psychologi 


responses of 14 
their theoretical 
Rogerian (8 were affiliated with the Counsel- 
ing Center of the University of Chicago). 
This group is compared to 64 psychologists 
who professed to follow psychoanalytic prin- 
ciples broadly defined. Actually, they selected 
a total of 93 “labels,” which were distributed 
over 14 categories; 72% of the choices were 
accounted for by: Psychoanalytic orientation 
(general or orthodox), Sullivan, and eclectic.* 

Summary Statistics on age, experience, and 
personal analysis are presented in Table 1. 
The following data shed some further light on 
the composition of the samples: 


i * Grateful acknowledgment is made to all psycholo- 
Study eave generously of their time to make this 
sudy possible. Thanks are also due the following or- 
ganizations: VA Benefits Office, Washington, D. C.; 

A Hospital, Perry Point, Md.; Maryland Psycho- 
logical Association; Postgraduate Center for Psycho- 
therapy, New York, N, Y.; Counseling Center, Uni- 
versity of Chicago. 
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Table 1 


Summary Statistics of Age, Experience, 
Personal Analysis 


Sample A* Sample Rè 
Statistic Ne Mean SD Ne Mean SD 
Age 65 35Gyrs. 8.7 13 334yrs. 64 
Experience 
intherapy 62 3.3yrs. 3.1 12 30yrs. 24 
Personal 
analysis 33 21hrs. 198 9 142hrs. 101 


a Psychoanalytically oriented psychologists. 

b Rogerian psychologists. “ 

2 Fhntaticns reflect absence of complete information and/or 
not having had personal analysis. 


Two-thirds of the psychoanalytically ori- 
ented psychologists (Sample A) held the 
Ph.D. degree, as compared with 36% of the 
psychologists who followed Rogers’ theory 
(Sample R). 

Sixty per cent of the members in both 
groups said they had a fair amount or 4 
great deal of experience in therapy and con- 
sidered themselves competent therapists. All 
members of Sample R said they practiced 
client-centered therapy exclusively. Sample A 
showed a wider distribution, but most replies 
fell within the broad category of psychoana- 
lytically oriented psychotherapy. Most Roger- 
ians indicated that they had received very 
little training in psychoanalytic principles 
and techniques; 69% of Sample A claimed 
“a fair amount” or “a great deal.” 

Sixty-four per cent of Samp 
ceived their personal analysis 
client-centered framework. The responses 0 
members of Sample A who indicated that they 
either had completed or were in the process of 
undergoing personal analysis (more than half 
the group) suggested that their analyses were 
based upon psychoanalytic theory. r 

Approximately one-half of the members m 
both groups stated that they devoted more 
than 25% of their time to the practice of psy- 
chotherapy. Almost two-thirds of Sample R 
specified their therapy as being primarily with 
neurotic patients. Thirty-eight per cent of 
Sample A responded similarly, but another 
third said that their patients represented a 
wider range of personality disorders. 
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Sample A appeared to treat their “average 
patient” for longer periods than Sample R: 
38% of the former group described the length 
of therapy as exceeding one year, as con- 
trasted with 14% in the latter. On the other 
hand, Rogerians predominantly saw the “av- 
erage patient” twice a week, whereas the 
modal frequency for Sample A was closer to 
one weekly session. 


Results 


Therapists’ responses to the film, that is, 
communications to the patient, were quanti- 
fied by a multidimensional system of analysis 
which has been described previously (11). 
Questionnaire responses to each item were 
coded and the frequencies tabulated. In view 
of the small size of Sample R, response cate- 
gories within an item had to be combined. 
Typically, this resulted in 2 X 2 tables which 
were tested by means of chi square (corrected 


for continuity).° 
1 Evaluations and Therapist Attitudes 


o the question of diagnosis re- 
vealed no significant differences. It seems note- 
worthy, however, that no member of Sample 
R chose such labels as psychopath, schizoid, 
paranoid, or character disorder, which were 
used by appreciable minorities of Sample A, 
as well as by psychiatrists whose response 
distributions have been presented elsewhere 
(12). Asked to state the patient’s major de- 
fense mechanisms, Sample R named a rela- 
tively smaller number than Sample A (ratio 
of 1:3), but the distributions did not appear 
to differ significantly. Nor did the samples 
differ in terms of qualitative descriptions of 
the patient’s emotional dynamics. 

Evaluations of the degree of ego strength, 
anxiety, insight, social adjustment, and dis- 
turbance disclosed no statistically significant 
differences. 

The members of Sample R judged the prog- 
nosis with therapy to be more favorable than 
the members of Sample A (p = < .05): no 


5 A table showing the response distributions of the 
two samples in percentages and giving probability 
values for p=<.10 has been deposited with the 
American Documentation Institute. Order Document 
No. 5587, remitting $1.25 for microfilm or $1.25 for 
photocopies. ‘ 


Clinica 


Responses t 
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Rogerian therapist considered it unfavorable. 
By contrast, an unfavorable Prognosis was 
given by 40% of the therapists in Sample A, 
who were in closer agreement with the predic- 
tions made by psychiatrists. i 
A larger proportion of Rogerian therapists 
professed a positive attitude toward the pa- 
tient than analytically oriented psychologists 
(p = < .02). Members of the University of 
Chicago Counseling Center unanimously de- 
scribed their attitude as positive. Those re- 
sponding negatively often stated that their 
attitude was influenced by the patient’s hos- 
tility, anger, and dependency; those respond- 
ing positively stressed his personality assets 
or saw him as “a patient with a problem,” a 
response often given with some empathy. 


Plans, Goals, and Dificulties in Therapy 
Sample R show, 
up therapeutic goals than Sample A (p = = 


Psychologist groups. 
Concernin, 


with almost 80% in Sample A; 
Rogerians answered the question i 


numerous areas were mentioned by Sample A 
therapists (p = < 001). Similarly, Rogerians 
were less likely to name areas in the Patient’s 
living which should be singled out for focus 
in therapy (p = < .001). 

Rogerians either declined to specify atti- 
tudes or behaviors which the therapist should 
encourage in therapy with his Patient or 
stressed the expression of feelings. Sample A 
therapists were more likely to stress: a sense 
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of responsibility, increased socialization, relat- | 
ing feelings and symptoms to interpersonal 
situations, etc. (p= < .02). 

Conversely, Sample A therapists were more 
likely to discourage attitudes and behaviors, 
such as: intellectualization, obsessive rumina- 
tions, self-pity, self-depreciation, helplessness, 
refusal to accept responsibility, demanding 
attitudes, and acting out; Rogerians, by com- 
parison, tended to say they would discourage 


nothing or leave it to the patient (p = < 
.001). 


about therapist’s activity or passivity did not 


mind for possible later reference, All mem- 
bers of Sample A who answered the question 
(85%) mentioned one or more clues, Four 
(p=a< 
about the pa- 
tient’s feelings and attitudes but, in contrast 


about their dynamic Significance. 
Descriptions of the course of the transfer- 
ence did not diverge significantly, but mem- 
bers of the two sa 
Proaches to the Problem (p = < .001). Rog- 


erians Predominantly encouraged or fostered 
a “corrective emo 


veying Tespect or 


Responses to a question dealing with “act- 
an aspect of the transference prob- 


lem, revealed a similar pattern: no statisti- 
cally significant differences with respect to its 
aia but divergence in terms of “han- 
ling.” Here, too, Rogerians recommended 
understanding, clarification, and reflections; 
analytically oriented therapists preferred an 
interpretive approach (p = < -001). 


Evaluation of and Attitude Toward the Film 
Therapist 


A number of questions were included to 
study similarities or differences between the 
film therapist’s and the respondent’s ap- 
Proaches to interviewing. It was hoped that 
in this way it might be possible to obtain a 
. Clearer picture of the respondent’s own pro- 
cedure. 

pele R therapists were more definite in 
ae assertion that they would have con- 
Uucted the interview “in a very different man- 
ner” (p= < 02). They dissociated them- 
selves from his approach and tended to evalu- 
ate his performance as “a very inadequate 
job”; the majority of therapists in Sample A 
Considered his performance reasonably ade- 
quate (p = < .01). 

Within each sample, there was notable dis- 
baa as to whether the therapist had 
een too passive or given insufficient support, 
De t the intersample comparisons. were non- 
Significant. 

Rogerians and psychoanalytically oriented 
therapists disagreed very markedly about the 
amount of time they would have devoted to 
obtaining data on the patient’s life history: 
15% of Sample R stated that they would have 
Spent somewhat less or considerably Jess time 
than the film therapist; almost one-half of 
Sample A said they would have devoted some- 
What more or considerably more time (P= 
< .001). The transcript shows that about 
10% of the therapist’s interventions can be 
Construed as case history questions in the 
Usual sense. These questions were usually 
asked in the context of the patient’s story, 
and attempted to clarify a time, place, oF 2 
terpersonal event. On the other hand, the 
therapist frequently repeated a word or phrase 
în a questioning tone of voice, apparently to 
Obtain further data on a feeling OF attitude. 
nae two samples revealed a statistically 

ighly significant difference in terms of their 
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attitude toward the therapist. The majority of 
Rogerian therapists described their attitude as 
negative, whereas most analytically oriented 
therapists professed a positive or neutral atti- 
tude (p = < .001). 

A supplemental question disclosed that the 
respondents’ criticisms were directed at the 
film therapist’s technique as well as at his 
person. Prominently mentioned by both sam- 
ples were the following objections: Therapist 
was not in control of the situation, engaged 
in too much activity but not of the “right” 
kind or not at the “right” time, too much in- 
terference with patient’s talk, too much “ac- 
centing” (repeating last word), wrong em- 
phasis, no plan. Rogerians criticized him es- 
pecially for failing to focus on the patient’s 
feelings and attitudes, and for a lack of em- 


pathy. 
Interviewing Techniques 


Analyses of therapists’ communications to 
the patient disclosed that Rogerians strongly 
favored the reflection-of-feeling technique, 
which comprised 67% of their responses. The 
comparable percentage for analytically ori- 
ented psychologists was 17. The technique 
preferred by Sample A consisted of explora- 
tory questions (40%). The number of “si- 
lent” responses given by Sample R was sig- 
nificantly smaller than that of Sample A. 
Communications showing a high degree of in- 
ference or initiative were rare in Sample R; 
Sample A had 3 to 8 times as many responses 
in these ranges. 

As might be expected, Sample R therapists 
adhered quite consistently to the reflection- 
of-feeling technique, even when the patient 
pleaded for a direct answer from the thera- 
pist. Many analytically oriented therapists 
responded to this plea with a direct answer. 


Discussion 


In interpreting these findings it must be 
d that the sample of Rogerian 


kept in min 
therapists was small. This deficiency was, 


partly mitigated, however, by the fact that 
this group was compared with a considerably 
larger sample of analytically oriented thera- 
pists to whom they were roughly comparable 
in terms of training and level of experience. 
Furthermore, on 4 number of questionnaire 
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items, Sample R revealed almost complete 
unanimity which undoubtedly reflected homo- 
geneous training in a single setting (The Uni- 
versity of Chicago Counseling Center); Sam- 
ple A, on the other hand, was made up of 
therapists from a variety of backgrounds. It 
may be noted that psychoanalysts (members 
of the American Psychoanalytic Association), 
whose training might be considered reason- 
ably homogeneous, varied more widely in 
their responses. 

The results showed a number of pronounced 
differences in approach which highlighted dis- 
crepancies between therapists subscribing to 
Psychoanalytic principles and the client-cen- 
tered framework. Both Positions are too well 
known to Tequire exposition in this context. 
It seems appropriate, however, to quote what 
Rogers considers to be the distinctive empha- 
Ses of client-centered therapy: 


A second distinctive aspect [the first is the em- 
Phasis on research 


one of 
and least accepted tenets in con- 
thinking], with the primary prob- 
of his i 


to the extent 


oretic picture 
(9, p. 207) 6 


€ It is difficult to see how the terms «, 
control,” in the sense that Rogers seems 
do in fairness characterize the mainstr 
temporary psychoanalytic thinking. A si 
fusion seems to arise from the concep 
psychotherapist who functions in the role of a pro- 
fessional expert ipso facto manipulates the Patient or 
controls him, and that guidance in the educational 
sense is synonymous with authoritarianism, Compare, 
in this connection, the formulations of a Prominent 
psychoanalyst regarding therapeutic goals and the 
ipart played by the therapist: 


Tredtment, of course, is aimed at the solution of 


guidance and 
to use them, 
eam of con- 
emantic con- 
tion that the 
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Rogers’ conception of the “ideal” therap 
is that of a participant in an interpersonal 
situation whose primary function is to empa- 
thize with and understand the patient within 


the patient’s difficulties in living and the cure of his 
symptomatology. Ideally these therapeutic goals will 
be reached by the growth, maturation, and inner in- 
dependence of the patient. . . . This goal will also 
be actualized by the development of his capacity for 
self-realization, his ability to form durable relation- 
ships of intimacy with others, and to give and ac- 
cept mature love (3, p. 34). 

+ Security and inner independence of the au- 


thoritarian values attributed to the conventional re- < 


quirements of our culture are indispensable for the 
therapist who wants to guide his patients successfully 
toward finding out about the degree of cultural ad- 
justment which is adequate to their personal needs 
(3, p. 33), 


The psychiatrist's Tespect for his patients will also 
help im to safeguard agai 
& an attitude of personal 


“irrational authority” instead of listening and con- 


ducting therapy in th 
ance. This irrational 
harmful not only be 
the patient’s tendency toward 
tion but also, and m; i 

tutes a traumatic re 


pattern in particular, to which 
most mental patients have been harmfully subjected 
in their past (3, p. 17). 

In his third point of difference, 
the experiential element 


to follow a design for action dictated by his theory. 
Psychotherapy based on psychoanalytic principles 
does differ from other forms of psychotherapy in its 
emphasis on giving the patient a rational under- 
standing of his interpersonal processes as they emerge 
in the therapeutic relationship. The emotional experi- 
ence remains uppermost, but, in addition, the patient 
Sains a conscious appreciation of his own contribu- 
tion to his difficulties in interpersonal relations. 
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his (the patient’s) frame of reference. From 
this vantage point, the therapist is imposing 
an external frame of reference if he attempts 
to diagnose, assess, or prognosticate. The same 
dictum would apply to hypotheses or hunches 
the therapist may have about the etiology of 
the patient’s conflict or how best to help him 
through psychotherapy. By this definition, the 
therapist who explicitly or implicitly goes be- 
yond the patient’s phenomenological self-de- 
scriptions is not client-centered. 

Certain objections voiced by Rogerian thera- 
Pists regarding the experimental procedure are 
understandable from this point of view. While 
they cooperated willingly, they made it clear 
that ordinarily they do not work this way- 

On this basis, too, the following results are 
Consistent with the client-centered viewpoint: 
a reluctance to make a diagnosis beyond the 
general label “anxiety,” to formulate thera- 
peutic goals, to mention dangers that might 
be encountered in therapy OY cautions that 
would have to be observed, to encourge OF 
discourage specific attitudes Or behaviors 10 
the patient, to treat him with strictness, tO 
discourage the free expression of feelings 
(free association), oF generally to consider 
problems of technique oF “handling.” 
erians were also disinclined to make inferences 
about the patient’s pehavior in the interview 
situation, the etiology of his disturbance, or 
the dynamic import of his behavior. Finally, 
they de-emphasized case history questions. 

One of the sharpest discrepancies between 
client-centered and analytically oriented theres 
pists related to the question of prognosis: #0 
Rogerian gave an unfavorable estimate, where- 
as 40% of Sample A took a pessimistic view. 
How ean this finding be explained? 

First, it must be considered that our knowl- 
edge of neurotic disorders and psychotherapy 
is not sufficiently developed to permit specific 
Predictions about the outcome of treatment 
even when a great deal is known about the 
Patient. Such predictions undoubtedly become 
increasingly accurate as therapy P 
and the therapist comes to learn more about 
the nature of the conflict, its ramifications, 
its history, and the patient's curre 
functioning. Thus, & prognostic É 
on a single interview may be little more than 
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a guess, which may reveal more about the 
therapist than about the patient. 

Second, the key issue in this comparison 
seems to be the high degree of uniformity 
among Rogerians which was not paralleled by 
the analytically oriented therapists whose re- 
sponses appeared to be more “normally” dis- 
tributed. If therapists were talking about a 
specific event, the predictions of some obvi- 
ously must be right and the predictions of 
others must be wrong. Unquestionably, thera- 
pists were not talking about a specific event 
but about a therapeutic outcome concerning 
which a wide range of ideas and opinions were 
entertained. 

In an attempt to shed some light on this 
result, I propose to examine the following al- 
ternatives: (a) Rogerians gave a more favor- 
able prognosis because they perceived the pa- 
tient as less disturbed; (b) Rogerians planned 
for more modest therapeutic goals and there- 
fore gave a more optimistic prognostic esti- 
mate; (c) prognostic estimates may be rela- 
tively unrelated to the presenting problem or 
the therapist’s past successes with similar pa- 
tients, but reflect more directly the thera- 
pist’s attitude, his theoretical orientation, or 
combinations of these. 

(a) The available evidence indicates that thera- 
pists in both samples tended to regard the patient 
as seriously disturbed. They were also reasonably 
agreed that he suffered a great deal of anxiety, that 
he was emotionally jmmature, socially maladjusted, 
and that he had relatively little insight. There is no 
reason to believe, therefore, that Rogerians judged 


the patient’s difficulties as less severe. 
(b) It is difficult to judge similarities or differ- 


of the terms of reference. Rogerians tended to ad- 
vocate greater self-acceptance ; 
therapists tended to strive for some insight. How- 
ever, the latter group generally did not recommend 
the more intensive forms of psychotherapy usually 
associated with psychoanalysis. On this basis, it 
seems fair to say that the Rogerians’ more favorable 
prognostic estimates were not a function of more 
limited therapeutic goals. 

(c) It has been reported previously (12) that 
there was @ highly significant statistical relationship: 
between psychiatrists’ prognostic estimates and their 
self-ratings of their conscious attitude toward the pa- 
tient (r= 39). For psychoanalytically oriented psy- 
chologists, the correlation was r= 42, Among Rog- 
erians, the jnvariance between attitude and prog- 
nosis was almost complete. Eight therapists at the 
University of Chicago Counseling Center expressed’ 
a positive attitude and rated the prognosis favorable. 
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In the case of psychiatrists, it was found 
that both attitude and prognosis were signif- 
cantly associated with other clinical evalua- 
tions and treatment plans. In addition, thera- 
pists’ attitudes tended to be reflected in the 
emotional tone and the degree of empathy 
of their communications. These findings sug- 
gested the interpretation that clinical assess- 
ments tended to reflect, in part at least, the 
therapist’s emotional reaction to the patent.” 
On the other hand, if the therapist had un- 
dergone personal analysis, his empathy tended 

to be greater irrespective of his conscious atti- 

tude. In other words, personal analysis seemed 
to introduce some distance between a nega- 
tive reaction to the patient and the therapist’s 
ability to empathize with him. It is possible, 
then, that the therapist’s i 


toward the patient is less important than what 
he does about it,8 


7 It seems reasonable to assume that clinical evalua- 
tions, treatment plans, and goals are a function of 


the diagnosis, Comparisons of therapists (based on 
the total sample) giving a “pure” diagnosis of Hys- 
teria, Obsessive-compulsive i 


showed a number of statisti 


value judgment which in 
turn may be determined by the therapist's attitude 
toward the Patient, The data seemed to favor this 


conclusion, 

8 It should be Tecalled th 
tion of therapist's consci 
tient, as used in thi 


scious attitude, 
difficult to say 


It is my impression that total reactions to a pa- 
tient are transferences of the analyst to his patients 
and are revivals of ancient transference Potentials, 
These may be manifested in the over-all attitude to- 
ward patients as a class or may exacerbate in the 
“whole response” to particular patients. These atti- 
tudes may be positively or negatively toned, They 
are likely to manifest themselves early in the contact 
with a patient and determine the tendency of the 
analyst towards the whole case (4, p. 4). 
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To integrate a workable therapeutic rela- 
tionship, the therapist, according to psycho- 
analytic theory, must convey an attitude of 
acceptance, patience, respect, etc. He must 
also be able to empathize (1, p. 580). This 
does not mean that he must have or should 
have a positive attitude toward all aspects of 
the patient’s behavior, Rather, it is recog- 
nized that the therapist, like other people, 
may experience emotional reactions. However, 
he is enjoined to be vigilant to make sure that 
they do not interfere with the therapeutic 
Process and if they do, to seek clarification 
through self-analysis or other means. 

The emphasis on diagnosis and etiology, ac- 
cording to analytic theory, determines at least 
Partially the therapist’s approach to therapy- 
Reich says: 


approaches an aggres- 
sive patient unlike a masochistic one, a hyperactive 
one, that one changes 
patient according 
does not behave 
neurotically oneself, even though one may have to 
in oneself. 

One cannot give up one’s own individuality, a fact 
which one will consider in the choice of patients. 


viduality is not a disturbing factor and that the 
the necessary mini- 
mum in plasticity of character (6, p. 139), 


From these considerations it would follow 
that, ideally, the Prognosis for any one pa- 
tient represents a realistic assessment of fe 
severity of the disturbance reflecting clinica 
experience regarding the response of similar 
patients to Psychotherapy, 

While evidence has been presented (12) 
that a prognostic estimate may be based on 


the therapist’s emotional reaction to the pa- 
tient rather than on 
does not foll 


ality change postulated by Rogers (10) is m 
therapist’s “unconditional positive regard” fo 
the patient, 


| 


d 
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ance and of a selective evaluating attitude. 
Unconditional positive regard appears closely 
related to empathy, another of Rogers’ key 
postulates, which is defined as the therapist’s 
experiencing an accurate, empathic under- 
standing of the client’s awareness of his own 
experience” (10, p. 99). 

Second, in explicitly rejecting the usefulness 
of diagnosis for psychotherapy, Rogers denies 
that the therapist’s approach or operations 
should be influenced or modified by the type 
of patient or disturbance (10, p. 101). This 
would also imply that prognostic estimates, 
to the extent that they attempt to take into 
account the severity or chronicity of the pa- 
tient’s disturbance, are pointless. 

Thus, it appears logical that the client-cen- 
tered therapist who fully accepts the theory 
Must (a) describe his attitude toward the pa- 
tient as positive and (2) give a favorable 
Prognosis. The ratings under discussion seem 
to reflect very clearly the respondents’ theo- 
retical orientation and are perhaps best ex- 
Plained on this basis. 

Whether a conscious attitude toward the 
Patient is a more or less individual expres- 
Sion of the therapist’s emotional reaction OF 
whether the attitude is an intrinsic part 0 
the therapist’s theoretical framework, or both, 
the more important question relates to the 
manner in which this attitude is expressed in 
the therapeutic situation. Some evidence (12) 
has been adduced that there is in fact a carry- 


Over. It remains to be demonstrated to what 


extent the therapist’s initial attitude town 
urse and outcome 


the patient influences the co 

Of therapy, but there seems to be a very real 
Possibility that the therapist making a nega- 
tive evaluation and/or reacting negatively to 
the patient may unwittingly contribute to the 
realization of the events he diagnoses OT pre- 
dicts. Contrariwise, the therapist who brings 
a genuinely positive approach to bear upon 
the relationship may thereby promote & more 


client-centered theory emphasize © 
Son of the therapist, as revealed 


nr in modern psychotherapy: pain 
= still give a clearer picture © 
ee in this connection [2].) 
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tionship, will in time serve as a new, more 
mature, and more desirable model of reality 
than past interpersonal relationships which 
have distorted the patient's perceptions of 
himself and others (13): 


What is curative in the [therapeutic] process is 
that in tending to reconstruct with the analyst that 
atmosphere which obtained in childhood, the patient 
actually achieves something new. He discovers that 
part of himself which had to be repressed at the 
time of the original experience. He can only do this 
in an interpersonal relationship with the analyst, 
which is suitable to such a rediscovery... - Thus, 
the transference phenomenon is used so that the pa- 
tient will completely reexperience the original frames 
of reference, and himself within those frames, in a 
truly different relationship with the analyst, to the 
end that he can discover the invalidity of his con- 
clusions about himself and others (7, p. 151). 


Rogers puts it this way: 

In a minimal way, the client may perceive from 
the first the unconditional positive regard of the 
therapist for him. The perception is continually 
strengthened as he discovers that each facet of him- 
self which is exposed—contradictions, weaknesses, 
strengths, abnormal feelings, tender feelings, vicious 
attitudes, antisocial behaviors, fears and despairs— 
are all met with equal positive regard, because each 
of these elements js a part of him, and he is prized 
unconditionally. The client then gradually takes in 
the experience of being Joved—a love which is non- 
possessive and nondemanding, warm but not over- 
As he lives for 2 sequence of hours in this 
atmosphere, the experience has two primary results. 
to relax the tight defensive structure 


of himself and to admit into aware- 
lly experience attitudes which previously 


ness and ful 
too threatening. - - - In the second 


had found e 
Ber itude of the therapist toward him is 


ized so that he can take the same 
d himself, He comes to prize himself, 


to be learned about the 
therapist’s personality and its contribution to 
the treatment process, but, as I have sug- 
gested elsewhere (11), this focus on the per- 
son of the therapist may be one of the most 
fruitful avenues for research in this area. 


Summary 
This investigation was designed to obtain 
empirical evidence on psychotherapists’ per- 
formance in an jnitial interview for the pur- 
pose of studying the influence of relevant 
therapist variables. 
Psychotherapists were asked to respond as 
vicarious interviewers to a sound film of an 


Much remains 
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unrehearsed initial interview. Data were col- 
lected from 235 psychotherapists in several 
cities. The present paper, part of a larger 
project, was concerned with a comparison be- 
tween 64 psychoanalytically oriented thera- 
pists and 14 therapists following Rogers’ 
client-centered theory. All respondents were 
psychologists, and 8 Rogerians were staff 
members of the University of Chicago Coun- 
seling Center. 

Statistical comparisons of questionnaire re- 
sponses to a series of items dealing with diag- 
nosis, prognosis, 
tudes disclosed a number of significant differ- 
ences between the two samples. 


able, and they rated thei 
patient as more positi 
ented therapists, 


In discussing the im 


ssed the great 
Pist’s contribu- 
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A Theoretical Framework for Nondirective Play 
Therapy: Concepts from Psychoanalysis 
and Learning Theory 


Dell Lebo 


Richmond Professional Institute 


oo systematic thinking progressed, 
ee from a position of relative 
ence ty in 1905 into one of decided promi- 
were in 1930. At first, aggressive impulses 
of id ag as derivatives Or components 
eich uality (10). Later Freud contended that 
ager — had its own power of becoming 
ae deprivations being especially pro- 
ke aggressive responses On 
(6 oy s formulation of the death instinct 
of. a next led him to assert that a portion 
N instinct, directed toward the outer 
stinct. was manifested as an aggressive in- 
that . However, it was not until 1930 (8) 
reti a substantial body grew onto the theo- 
ag gal framework of aggression. A desire for 
pe was then said to be an independ- 
ae innate drive. This instinctual disposition 
Se in intensity from man to man. Libido 
ae were viewed as primary in- 
and s entwined with strivings toward life 
death (6). 
ieee relationship between aggression and 
k Privation was experimentally examined by 
arning theorists and found to þe relevant. 
Sree peek learning theory has gi 
tise to aggression. At first it was 
a frustration was a direct a 
wee (2). As the investigatio 
giv ed, it was realized that frustratio 
whic rise to a variety of responses, o 
ich could be some form of aggression 
‘adage was viewed as 4 secondary, rat er 
as a primary, drive because it id no 
or m to involve any piological changes in the 
ganism. Instead, aggression Was held to be 


a simple, learnable response, subject to modi- 
fication. The selective agent in the learning 
of adult aggressive habits was reinforcement. 
The position of aggression in the hierarchy 
of responses tO frustration depended upon 
whether past conditions were such as to re- 
inforce aggression as a response to external 


cues. Despite a continued emphasis on the 


importance of learni 
theorists no longer 


factors (3). 
There is an interesting parellel here. Two 


powerful psychological viewpoints seem to 
have gradually admitted aggression jnto more 

thetical realm. Such a 
nge in two independent systems of 
foreshadow the eventual impor- 
jon in other psychotherapeutic 
theories. The theoretical development of ag- 
gression indicates it would be worthwhile to 
consider its possible importance to a psycho- 
therapeutic theory that does not at present 


include it. 


ng in aggression, learning 
deny the role of innate 


Aggression and Client-Centered Theory 

of psychological systems, 
the nondirective or client-centered approach, 
has not directly incorporated aggression. The 
fourth proposition of Roger’s formulation of 
personality is concerned with “the tendency 
of the organism to behave defensively in the 
t, to achieve the goal of self- 


face of threat, 
maintenance even when the usual pathway to 


that goal is blocked” (2 
he included these tendencies, which might 


sound like aggression, with food as: 


One of the newest 
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and a general striving toward maturation, the 
tendency to which all organic and psychologi- 
cal needs might be ascribed by nondirectivists, 
If the importance achieved by aggression in 
the two concepts previously discussed is a 
proper forecast, then it appears likely that it 
is through this proposition that aggression 
will enter nondirective personality theory. 


Age and Aggression 


In both psychoanalytic and learning theory 
the appearance and expression of aggression 


k with children i 
qualities reach the » Aggressive 


and become especially evident 
Oedipal Period (5). When th 


an example of further learning which enables 
earlier, more diffuse, Tesponses to be elimi- 
nated and more selective Tesponses, such as 
verbal aggression, to be utilized. This verbal 
aggression, however, is subject to modification 
by reinforcement. As the child grows older 
and reactions with adults become important 
to him, his pattern of aggression is modified, 
Progression from infantile diffusion to di- 
rected attacks, to verbal specialization, to a 
marked reduction seems to be the behavioral 
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pattern of aggression expression in normal 
children. N 

As a child grows chronologically, certain 
changes occur which influence the pattern of 
aggression. Whether these changes are called 
a developing superego or a modification 
through learning experiences, the position of 
aggression in the hierarchy of available re- 
sponses does seem to change in an observable 
manner, 

Other important behavioral changes take 
Place from one age level to another. Gesell 
and Ilg have indicated that as a child grows 
older the “interior patterns of his private psy- 
chology” are changing as well (11, p. 12). 
Such changes have been a concern of psycho- 
analytically oriented play therapists who ad- 
vocate different treatment approaches to chil- 
dren of different ages (16). 


Age in Nondirective Play Therapy 


Just as the concept of aggression has not 
been admitted into client-centered philosophy; 
so has the concept of personality changes with 
advancing age been lacking from formulations 
of the nondirective play therapy process. Per- 
haps the conceptualization of nondirective 
play therapy (1) excluded consideration of 
age differences because of the emphasis on 
process in nondirective therapy in play ther- 
apy: “Experiences with play therapy . . - 
add to the conviction that therapy is very 
definitely a process, a process which follows 
certain fundamental trends” (21, p. 170). 

Nondirective play therapy, based directly 
upon the techniques of nondirective counsel- 
ing, emphasizes the forces within each indi- 
vidual to find Mature behavior more satisfy- 
ing than immature behavior, “This type of 
therapy starts where the individual is and 
bases the process on the present configuration 

 -” (1, p. 15). Since the individual is ac- 
cepted where he js in client-centered therapy 
and the process begun, the child is accepted 
similarly where he js chronologically and the 
Process of nondirective play therapy begun. 

There may be a recognition that person- 
ality changes from age to age in the ex- 
pression of the one basic nondirective need, 
namely, the striving for maturity. However, 
such an implied recognition of age differences 
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ee not enter into the method of nondirec- 
aL play therapy. The process is the same for 

children admitted to the playroom regard- 
less of age. 


Studies of the Process of Nondirective 
Play Therapy 


a been shown, both age and aggres- 
im ie been found to be factors of keen 
F portance in other theories of psychother- 
PY, especially where children were concerned. 
TH neither factor has been considered gener- 
DH in studies of the process of nondirective 
Seles Such studies fall into two types, 
distin, ologically as well as chronologically 
Inguishable. 
ane udies of the earlier type involved exami- 
fee of the process of nondirective play 
Bas. te as found in already available proto- 
tion: Later studies were objective investiga- 
ns of the protocols of selected children. 


P; 
rotocol-Centered Studies 


Landisberg and Snyder (13) examined the 
os of four cases to determine what 
a place in nondirective play therapy- They 
Aa similarities in the process from case to 
ai e. Although the four children ranged in 
from five to six years, the categories use 
V E siy the verbal remarks had been g 
eloped for use with adults. Since the cate- 
Bories did not originate from children’s ver- 
alizations, their representativeness may have 
ioe forced and unrealistic. Furthermore; the 

STOW age range prevented inferences re- 
Bading the process of nondirective play ther- 
PY at different age levels. y i 
me: a Procrustean forcing of children $ T e 
Fi nts into adult categories Was obviated bY 

aa (4) who developed new categories 
ea povan analysis of children’s statemen's 
me € in nondirective play therapy- She u < 

Otocols from six children ranging in ag 
am five to eleven years. It was found that 

© children, though in therapy with different 

“rapists, showed similar trends in their ver- 

al expressiveness. Her study did not consider 
ae Possibility that just as the wide age ¢ r 
aloe between adults and children ™S- 

uence their verbalizations, S° might chil- 
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dren’s categories vary significantly from one 
age level of maturity to another. 

Seemingly the last study of this type was 
submitted for publication in 1952 (18). It 
was concerned with similarities in the pattern 
of emotional growth of normal and disturbed 
children. Extensive excerpts, arbitrarily se- 
lected and subjectively interpreted, revealed 
that “the emotional process and the changes 
in feeling tones evident as a child goes through 
play therapy --- occur... not step by 
step, but in individually varying sequences” 
(18, pp. 97-98). 

This study was nonobjective and resembled 
the suggestive investigations appearing in the 
persuasive Or propagandistic period of re- 
search in nondirective play therapy (15). No- 
where was consideration given to age. 


Child-Centered Studies 


The first publication of the later type of 
investigation was apparently that of the pres- 
ent writer (14). Twenty children, aged 4, 6, 
8, 10, and 12 years, equated for intelligence 
and social adjustment, were used as subjects. 
presented by chronological 


Maturation, as Te c 
age, was found to account for different types 


of statements made in the nondirective play 
situation. 

Similar studies by Moustakas (19, 20) have 
appeared since. One of them (19) studied the 
frequency and intensity of the expression of 
negative attitudes of nine well-adjusted and 
nine disturbed young children matched in 
various characteristics. At the end of four 
play therapy sessions, both groups expressed 
about the same types of negative attitudes. 

Another example of subject-centered Te- 
search concerned 10 four-year-old children 


ithout serious emotional problems 


with and w. em: 
(20). “Data obtained -- - showed more simi- 


Jar than divergent behavior in the two groups 
_. 2? (20, P. 155). The most significant dif- 
ference between the groups was that the mal- 
adjusted children were nonattentive. This dif- 
ference was explained by the maladjusted 
children’s noninteractive behavior, i.e., fan- 
tasy or activities that excluded the therapist. 
The degree of aggressiveness was not con- 
trolled. One wonders if the results would have 
been the same had aggression been considered. 


278 


The above mentioned studies represent all 
of the published work on the process of sn 
directive play therapy known to the presen 
writer. While the studies are similar they are 
not directly comparable. In only four investi- 
gations does age seem to have been controlled. 
In three publications, age was regulated by 
restriction; only children within a narrow age 
range were studied: 5-6 years (13) and 4 
years (19, 20) respectively. Hence, only one 
study clearly took age differences into account 

(14). This study alone found definite changes 
in the types of statements made by children 
in nondirective play therapy. 

Only two of the studies clearly controlled 
intelligence (14, 19). Hence, differences in 
intellectual ability, long recognized as being 
of fundamental importance in speech habits 
(vide the items of the Stanford-Binet Intelli- 
gence Test), have not been considered in 
many studies of the verbalizations made in 
nondirective play therapy. This lack would 
seem to be of sufficient magnitude to vitiate 
investigations that have failed to control for 
it. None of the studies considered the possi- 
bility of differences arising in verbalizations 


as related to aggressiveness or lack of ag- 
Sressiveness in children. 


The empirical 


y be in danger 
“regularity” of 
ctionism, it be- 


mproductive. A 
good theory is said to be economical in per- 


mitting many observations to be subsumed 
under a single proposition. Theories concern- 
ing changes ascribable in aggression or age 
would seem to be both economical and mean- 
ingful. 


Summary 


Psychotherapeutic processes may vary con- 
siderably as a function of both the age of the 
subject and the dynamic processes character- 
izing his psychopathology. In childhood, the 
relationship between age and aggression is es- 
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pecially close. Nondirective play therapy does 
not formally consider the influence of aggres- 
sion or age in its method. As a result, studies 
of the process of nondirective play then 
generally indicate that all children underg' 
the same process. It would seem, ae 
that if age and aggression were eval 
properly, the course of nondirective play the i 
apy would vary with the age of the child ami 
with the character of the psychodyn oa 
processes, e.g., aggression, associated with a 
defining his problem. Insistence on the nr 
ness of the process, and consequently of kei 
method, may only result in the tautologi 
death of productive work in nondirective play 
therapy. + 

Thess assertions were supported by inie 
ences drawn from the history of Freudian ne 
learning theory and by data from studies © 
the process of nondirective play therapy. 
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Personality Patterns of Patients Before and After 
Application for Psychotherapy 


Norman S. Greenfield 


University of Wisconsin Medical School 


A previous study (1) utilized the MMPIs 
of 132 male college students who later at some 
time in their four-year college course sought 
Psychotherapy at a student health psychiatric 
clinic, with the aim of testing the hypothesis 


l t person- 
ality factors, or more precisely what changes 


in personality, influenced the decision to ap- 
ply for treatment. Again, logic and clinical 
experience led us to assume that, other fac- 
tors being equal, a person seeks Psychother- 
apy at a time when he is feeling worse, or 


1An extended report of this study may be ob- 
tained without charge from Norman S, Greenfield, 
Department of Psychiatry, University Hospitals, 
Madison 6, Wisconsin, or for a fee from the Ameri- 
can Documentation Institute. Order Document No, 
5584, remitting $1.25 for microfilm or $1.25 for 
photocopies. 


suffering more than when he did not seek psy- 
chotherapy. a 

The oie administration of the MMPI* 
to entering students made possible an exami- 
nation of self-controlled profiles of 31 stu- 
dents who were given a second MMPI at the 
clinic. The Ss were 20 males and 11 females 
whose mean age was 19 years, The eee 
number of months intervening between firs 
and second test administrations was 10.97, 
with a range from 1 to 26 months. 

Clinically, the presenting complaints of the 
patients as well as their psychiatric dan 
reflected the usual range of patient materia 
encountered at the clinic, 

None of the differences between the scores 
of the two administrations approached signifi- 
cance. Both in pattern and amplitude pre- 
and posttests were almost identical. oi 

The voluminous body of literature utilizing 
the MMPI to demonstrate differences ca 
tween groups and, even more sensitively, 
changes in scores following peychotherapy 
Suggests caution in cavalierly discarding these 
data and turning to the parsimonious cha 
lenge of the validity of the technique. In any 
case, these results furnish some food for 
thought. 
Brief Report, 
Received January 30, 1958. 
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The Diagnostic Validity of the Ames “Danger Signals” 


Elise Elkins* 


Illinois Institute jor Juvenile Research 


a application of the Rorschach to very 
on subjects has resulted in an accumula- 
sae of studies indicating that children nor- 
ond give responses that are pathological in 
Ror. i" (10, 13). The publication of Child 
Sarit hach Responses by Ames and her as- 
e es (1) represented a milestone m that 
pea ‘age norms were presented system- 
a 7 ly at yearly intervals for a carefully 
4 ied group of children ten years of age and 
nder. Toward the end of this volume, Ames 
Presented a list of “danger signals” which, 
gee the developmental context of a 
ee, might still be considered 
icative of pathology. The present study 
was designed to test ‘whether these “danger 
a had sufficient diagnostic validity to 
ifferentiate between a clinic and a normal 
Population. As part of a study. of normal 
eight-, nine-, and ten-year-olds undertaken by 
the Institute for Juvenile Research, 54 Chi- 
Cago school children described as well-ad- 
justed by their teachers were given a com- 
plete diagnostic evaluation. For the purposes 
of this study, an effort was made to match 
each of these nonclinic cases with a child who 
had been referred to the Institute as being in 
need of child guidance services. The present 
report deals with a comparison of the Ror- 
Schach records of 40 nondisturbed children 


With the records of their matched controls. 


Subjects 


The Ss were 40 normal children (27 boys 
ho were 


and 13 girls) and their controls WP 
Matched for sex, age, and IQ. Matching was 
gratitude to 
ndisturbed 


in most cases within three months of age and 
five points of IQ. The matching for IQ was 
only approximate. All of the nondisturbed Ss 
were given Form L of the Binet by the same 
examiner, while their matched controls were 
given a variety of other tests, both group and 
individual. In all likelihood, the clinic group 
is slightly more intelligent than the nondis- 
turbed sample, since the clinic children were 
often matched on the basis of tests scores that 
are known to run lower than Binet ratings. 
This direction of a possible difference was 
considered safest so that there would be no 
question of the clinic children’s looking “sick” 
only because they were merely less intelli- 
gent. Actually, both the clinic and the non- 
disturbed children taken together constitute a 
highly homogeneous sample of children of su- 
perior intelligence. In this respect, both groups 
are comparable to the normative sample used 
by Ames (1, p- 25)- 

Although no effort was made to match for 
socioeconomic status, the matching for IQ re- 
sulted in a clinic and a nondisturbed sample 
which were quite comparable in this regard. 
The socioeconomic level of the Ss was evalu- 
ated by means of the scale of paternal oc- 

i Goodenough (6, pp. 

inical psychologists classi- 

Ss. In 39 of the 80 cases, all three 
d on the classification. In an ad- 
differed by one cate- 
gory from the other two. The S was then as- 
y agreed upon by two 

In the nine cases with 
three categories, the S 
to the middle category. Both 
d the nondisturbed group are 
slightly below the Ames sample in regard to 
socioeconomic status: 93% of the Ames sam- 
ple (1, P. 25) and 59% of the combined 


was assigned 
the clinic an 
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clinic and normal groups of this study fall 
into Categories I through III on the scale of 
paternal occupations. The atypically high 
socioeconomic status of the Ames sample in 
comparison to the general population raises 
the possibility of bias in the Ames normative 
data. In fact, Fiedler and Stone (5, p. 279) 
found striking differences between their sam- 
ple of undisturbed children of low socioeco- 
nomic status and the Ames sample of high 
socioeconomic status. However, in this study, 
any possible effects of bias in the Ames norms 
are controlled by the matched-pairs design. 


Procedure 


All 40 Rorschachs of the nondisturbed chil- 
dren were administered and scored by a psy- 
chologist with 15 years’ experience and certi- 
fication by the American Board of Examin- 
ers in Psychology. The 40 Rorschachs of 
the matched controls were administered and 
scored by 15 Psychologists of varying levels 


Table 1 
Descriptive Information About Subjects 
Used in This Study 
Nondisturbed Clinic 
G 
) Variable N S E ae 
Age 
vee 8410-0 8-39-11 
SD 108.38 mos, 108.15 mos. 
5.50mos. 5.40 mos, 
Sex 
Male 
27 
Female 13 of 
IQ 
Range 98-145 100-155 
Mean 120.15 120.30 
SD 12.52 14.06 
Socioeconomic status 
I, Professional 6 8 
IL. Semiprofessional and 
managerial 6 5 
III. Clerical, skilled 
trades, retail business 11 11 
IV. Semiskilled, minor 
clerical 11 9 
V. Slightly skilled 4 my 
VI. Day laborers 2 3 
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of experience. Because of the extreme diffi- 
culty of obtaining enough clinic cases to 
match with a group of normals of such high 
intelligence, it was not possible to control for 
experience or identity of the examiner. Since 
arrangements could not be made to have all 
80 Rorschachs retyped without identifying 
information, this study was limited to objec- 
tive signs whose presence or absence could be 
evaluated merely by a check of the scoring 
sheet. 

Of the 13 “danger signals” listed by Ames 
and her associates, 4 were dropped because 
they involved subjective judgments. The re- 
maining 9 were raised to a total of 13 because 
of the necessity of treating the parts of four 
complex signs as separate signs (e.g., Sign 10: 
AJ over 60 and no human responses). The 
13 signs used in this study are listed below 
with the numbering used by Ames (1, p. 283)- 
Qualifications introduced by the author are 
given in parentheses. 


1. Preponderance of tree or leaf responses (Pre- 


ponderance defined as over 50% of R) 
F% exceeds 75 


More than one pure color response p 
A. More than one response involving differenti- 
ated shading 


5B. More than one response involving diffuse, 
dysphoric shading, i.e., Clob 


More than one inanimate movement response 
8. W% less than 40 


9A. Dd% over 15. Dd% equals Dd, S, and Do 
responses over total R 
9B. More than one X response 


9C. More than one S response 
10A. A% over 60 


- No human response (ie, no H: Hd not 
counted) 
11. R less than 10 


The evaluation of the 13 signs was done by 
the author. A slight element of subjective 
Judgment could not be avoided in that some 
rescoring had to be done before even the ob- 
Jective Ames signs could be checked. Of the 
80 protocols used in the study, 70 were scored 
by the Beck system (2), while the Ames sys- 
tem is closer to the Klopfer method (9). For- 
tunately, it has been common practice at the 
Institute to make Marginal notations of m 
and FM. However, the elimination of sepa- 
rate D scorings for details covered in a 
and the division of shading scores into Clob 
(diffuse, dysphoric) and F(C) (differenti- 
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ated) also had to be done. The author pre- 
pared a detailed instruction sheet indicating 
the differences between the Ames and the 
usual clinic scoring in regard to those vari- 
ables that would be involved in an evaluation 
of the Ames danger signals. The scoring rec- 
ord for each of the 80 protocols was then 
transferred to a new scoring sheet, with each 
response being scored only for the relevant 
variables which are as follows: 


Area (W, D, Dd, Do response, S) 

Major determinant (M, m, FM, C, either FC or 
CF, differentiated shading, diffuse shading with 
dysphoric element, F) 

Content (H, A or Ad, tree or leaf) 


No differentiations other than those listed 
Were made. For example, no effort was made 
to differentiate between FC and CF. The 
Ames signs were then checked by counting 
the various types of responses On these scor- 
ing sheets, Tabulation of the Ames signs Was; 
of course, purely clerical once the scoring 
Sheets had been made out. 

„As for the possibility of the introduction of 
bias in the rescoring, the author can state 
only that there seems to be satisfactory eVi 
dence in the literature that mere scoring of 
Rorschach responses has sufficient interex- 
aminer reliability to warrant being regarded 
as an objective procedure (7, 8). However, 
as a reliability check, one-fourth of the proto- 
cols (10 normals and 10 clinic cases) were 
scored by a colleague as well as by the au- 
thor. The percentage of agreement oD the 
Scoring of location varied from 71 to 93 on 
the 20 records, with a mean of gi and an 
average deviation of 5.25 percentage points. 

he percentage of agreement on the scoring 
of major determinant varied from 65 to 100 
on the 20 records, with a mean of 84 and an 
average deviation of 7.05 percentage points. 
The percentage of agreement on the scoring 
of content varied from 77 to 100 on the 20 
records, with a mean of 91 and an average 
deviation of 6.10 percentage points. There 
Was perfect agreement on content scoring for 
a third of the records. 


i Results 
Total Scores 


_ The total scores on the Ames list of danger 
signals were compared for the clinic and the 
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Table 2 


Total Scores on Ames “Danger Signals” and Davidson 
Adjustment Signs in Matched Pairs of Clinic 
and Nondisturbed Subjects 


Non- 
disturbed Clinic 


Group Group CR 

Ames “Danger Signals” 

Mean 3.00 2.20 2:25* 

SD 1.55 1.75 
Davidson Adjustment Signs 

Mean 7.10 6.58 .57 

SD 2.27 2.84 

Prorated mean 9.26 8.60 


* Significant at .05 level. 


nondisturbed groups by means of a variation 
of McNemar’s Formula 26 for the evaluation 
of the difference between two correlated means 
(12, p. 74). The results are presented in 
Table 2. The clinic group had significantly 
fewer danger or maladjustment signs than the 
nondisturbed group. Before investigating the 
direction of the discrimination done by each 
individual Ames sign, the author compared 
the clinic and the nondisturbed groups by 
means of 13 of the 17 Davidson adjustment 
signs (4). The two signs involving color shock 
and shading shock respectively were omitted 
because they involve subjective judgment. 
The two signs involving FM and F% respec- 
tively were omitted because the records were 
scored by the Beck system. The Davidson 
signs were evaluated on the basis of the scor- 
ing done by the original examiners without 
any rescoring by the author. The results of 
this comparison are also presented in Table Os 
In contrast to the Ames signs, the Davidson 
signs show an absolute difference 1m the ex- | 
ected direction; however, the difference is so 
small that there is a high probability that it 
could be a chance deviation from a true dif- 
ference of zero (p > 60). Although all sta- 
tistical tests were done on the basis of the 13 
signs actually counted for both the nondis- 
turbed and the clinic groups, the mean based 
on 13 signs was prorated to obtain the esti- 
mated mean had all 17 signs been used. The 
prorated means are also shown in Table 2. 
‘An estimate of the accuracy of the prorating: 
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is provided by some additional data available 
for the nondisturbed sample only. The origi- 
nal examiner had evaluated the group on the 
basis of all 17 signs and obtained a mean of 
9.3. The prorated mean obtained by extrap- 
olating from the mean of 7.1 for 13 signs is 
also 9.3. The prorated means of 9.3 and 8.6 
for the nondisturbed and the clinic groups re- 
spectively are consistent with the results of 
previous studies which show slight differences 
between normal and disturbed groups with 
considerable overlapping of the distributions 
of scores. In the studies reviewed by David- 
son, means of 9.05 to 11.34 were reported for 
better-adjusted groups and means of 6.85 to 
8.17 for less well-adjusted groups (4). 


Individual Signs 

The Davidson signs (4) did not differenti- 
ate the nondisturbed from the clinic patients 
in the present study, and the Ames danger 
signals discriminated in the “wrong” direc- 
tion when evaluated in terms of total scores, 
Because of the possibility that individual 
Ames signs discriminated in different direc- 
tions, the author carried out a detailed analy- 
sis, sign by sign. The results of this analysis 
are presented in Table 3. 


Table 3 
Incidence of Ames “Danger Signals” in Matched Pairs 


of Clinic and Nondisturbed Subjects 
Nei Only 
Both ther Non- 
i of of Only dis- Chi 
Danger signal pair pair clinic turbed square 
1A Preponderance 
bes of tree and 
PS leaf R 0 40 0 0 ‘ 
2 F%>75 L306 ek of A 
3 PureC>1 a 3 25 0 50 
5A Differentiated 
shading>1° 3 21 6 140 56 
5B Diffuse, dysphoric 
shading > 1 0 36 3 1 25 
6 m>ti 0 36 4 0 2.5 
8 W% <40 17 3 6 14 245 
9A Dd% > 15 12 12 4 12 306 
9B X responses > 1 Oo Se S 2 57 
roc S>1 3% 2 asi O 
2 16 5 17 5.50% 
10A A% > 60 
10B No H 4 24 4 8 75 
11 R<10 0 39 0 1 0 


* Significañt at .05 level, 
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In the case of each sign, the number of 
instances of occurrence in the nondisturbed 
group and lack in the clinic cases were com- 
pared with the number of instances of occur- 
rence in the clinic group and lack in the non- 
disturbed cases by means of McNemar’s for- 
mula for chi square for dependent samples 
(12, pp. 204-206). The use of McNemar’s 
formula permits one to evaluate only those 
two cells of the fourfold table which repre- 
sent the difference critical for one’s hypothe- 
sis. In this case, only the third and fourth 
columns of Table 3 were compared. The Yates 
Correction for continuity was used in all com- 
putations. 


ful for differentiating between clinic and non- 
disturbed samples of eight- to ten-year-olds 
the signs are either 
in a sizable propor- 
clinic cases or else 
in the records of 


more than one response involving diffuse, dys- 
Phoric shading. The only “danger sign” which 
has differentiating Power that reaches statisti- 
cal significance jg Sign 10A (4% over 60). 
This sign discriminates in an unexpected di- 
tection: Of 22 matched Pairs whose members 
differ on this sign, three times as many non- 
disturbed as clinic cases have the high A%. 
The most Promising signs which discriminate 
in the expected direction are Signs 3 (pure 
C> 1), 5B (more than one instance of dif- 
fuse, dysphoric shading) and 6 (m> 1). 

hese Signs, like contamination for schizo- 
Dhrenia, are apparently diagnostic when they 
occur, but have such limited incidence as to 
be of little use for Toutine screening purposes. 


Ranges on Determinants Involved in the 
Ames Danger Signals 


A La V on 
a 
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Table 4 


Comparison of Matched Pairs of Clinic and Nondis- 
turbed Subjects in Regard to Scores Below the 
25th Percentile of the Ames Norms 


D ' Nei- Only 
? eterminantand Both ther non- 
evel necessary of of Only dis- 
to fall below pair pair clinic turbed Chi 


25th percentile 


below below below below square 

F% below 52 4 20 8 8 0 
No pure C 3 0 4 5 0 
Differentiated 

shading zero 10 15 5 10 107 

iffuse, dysphoric 

shading zero i 1 3 9 02“ 
eor zero 2 4 3 18B 50 
T% <28 11 8 7 14 1.71 
AA zero 1 31 É 2 1.12 
1% <40 3 24 6 7 0 

<13 0 33 2 5 ays 


* Signifi 
at Significant at .05 level. 
* Significant at .01 level, 


Probabilities, one further analysis of the data 
Was performed. The matched pairs of clinic 
and nondisturbed cases were compared in re- 
gard to the determinants underlying the dan- 
Ser signals in two ways: (a) frequency at or 
elow the 25th percentile ? of the Ames norms 
and (b) frequency above the 75th percentile 
of the Ames norms (1, pP- 54-56). These 
findings are presented in Tables 4 and 5. 
Table 4 indicates that in the case of those 
Matched pairs whose members differ in re- 
a to being below the 25th Ames percentile, 
Bae are significantly more pairs whose non- 
isturbed member is below the 25th percentile 
a number of m and for number of responses 
volving diffuse, dysphoric shading. (As be- 
Ore, only Columns 3 and 4 were compared by 
ane of McNemar’s formula for chi square 
er dependent samples.) Table 5 indicates 
at in the case of those matched pairs whose 
Members differ in regard to being above the 
i th Ames percentile, there are significantly 
w re pairs whose nondisturbed member = 
e Ove the 75th percentile for AJ and signi 
antly more pairs whose clinic member 1S 
zero as the score 
had to be made 


the 25th per- 
frequencies 


2 

for a the case of those signs with 

in re 25th percentile, comparisons 

ees to comparative frequencies at 

elon: since, of course, there could be 7° 
W zero, 


Ce; 
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above the 75th percentile for number of re- 
sponses involving diffuse, dysphoric shading. 

A comparison of Tables 4 and 5 with 
Table 3 lends no support to the author’s sus- 
picion that the Ames danger signals would 
be improved by the introduction of middle 
ranges of scores On various determinants. 
Three of the four significant differences in 
the latter two tables result from a change in 
the cutting score for variables which appear 
to have a linear relationship to good adjust- 
ment. Thus, a complete lack of m and of dys- 
phoric shading, rather than the presence of 
a moderate amount, differentiates the clinic 
from the nondisturbed sample. In the case of 
the fourth significant difference on A%, the 
data do not reveal whether there is any point 
at which the relationship between health and 
A% ceases to be linear in regard to the groups 
used in this study. The highest A% of 93 was 
found in the nondisturbed group, in addition 
to the fact that more of the undisturbed group 
exceeded the Ames 75th percentile (4% of 
58). 

Discussion of Results 


The Ames danger signals offer no ad- 
vantages over the other sign lists developed 
without special attention to the younger age 
groups and the developmental sequences par- 
ticular to them. Neither are the Ames danger 


Table’S 


Comparison of Matched Pairs of Clinic and Nondis- 
turbed Subjects in Regard to Scores Above 
the 75th Percentile of the Ames Norms 


Nei- Only 
Determinant and Both ther non- 
level necessary of of Only dis- 


pair pair clinic turbed Chi 


to exceed 75th 
above above above above square 


percentile 


F% above 78 2 26 3 9 2.08 
Pure C > 1 0 38 2 0 50 
Differentiated 

shading over 1 3 21 6 10 56 
Diffuse, dysphoric 

shading > zero À 18 18 3 9.33** 
m>1 0 37 3 0 1.33 
W% > 52 te ot 6 6 0 
Dd% > 16 11 12 4 13 3.76 
A% > 58 4 15 4 17  6.86** 
R>23 6 16 11 7 50 


++ Significant at .01 level. 


) 
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2 rse for screening purposes. The 
estates i of the Ames signs discrimi- 
nate in a direction opposite to that cies 
has been found to be true of conlp ata Sigi 
lists such as the Davidson adjustment signs. 
Brockway, Gleser, and Ulett (3), for Ss 
le, found that 8 of the 17 Davidson signs 
ie naled in a reverse direction when used 
on a population of adult males. ooo 
One of the studies most comparab tO IDE) 
one described in this paper was carried out 
at the same clinic by another investigator. 
Levitt (11) compared 39 clinic cases, includ- 
. ing 4 used by the present author, with the 
normative sample of Thetford, Molish, and 
Beck in regard to alleged Rorschach anxiety 
indices. He found that only Sum Y discrimi- 
nated in the expected direction at better 
than the .05 level of confidence. The discrimi- 
nating power of Y was improved by separat- 
ing the differentiated shading responses (FY) 
from those with less of a form element (YF). 
Similarly, in the study by the present author, 
the best discrimination was obtained by the 
use of Clob responses only, the latter being 
roughly comparable to the YF responses of 
Levitt’s study, However, the sum of all shad- 
ing responses had some discriminating power. 
‘When the 40 matched pairs of clinic and non- 
disturbed subjects were compared in regard 
to total number of shading responses, signifi- 
cantly more pairs were found with the normal 
subject at or below the Ames 25th percentile 3 
of zero shading responses (chi square 5.26 and 
2 <.05). When a similar comparison was 
made in regard to scores above the Ames 75th 
percentile, there was a Statistically insignifi- 
cant trend for more clinic than normal mem- 
bers of matched pairs to be above the Ames 
75th percentile for total number of shading 
responses. That is, complete lack of shad- 
ing responses is significantly associated with 
membership in the nondisturbed group, while 
having two or more shading responses is Jess 


8 The Ames percentile for total number of shading 
responses was estimated by adding the number of 
differentiated and diffuse shading responses at the 
given percentile. Thus the 25th percentile for all 
shading responses was estimated as zero, since zero 
is the 25th percentile for both F(C) and Clob. The 
75th percentile was estimated as 1 since the 75th 
percentile for F(C) is zero and for Clob is 1. 
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discriminating. Once shading responses are 
present, it is necessary to know the type a 
fore meaningful discriminations can be ma 
between groups. 4 

In zeneral. those signs and determina 
which discriminate in any way between t 
clinic and the disturbed group seem to have 
to do with tension (m, shading responses) 
and the stereotypy-conformity dimension o: 
behavior (4%). Both the clinic and the non 
disturbed samples are children of latency api 
The nondisturbed sample appears to be a 
tinguished mainly by a consolidation of a 
fenses. Apparently, deviation in the i 
of more control than the normative ae 
sample is not pathological at this age, whet 
deviation in the direction of less contia; 
identifies the patient population. Although p 
the adult, magnitude of deviation may os 
major importance, it is possible that in 3 
child the direction of the deviation in tem 
of the child’s developmental level is be 
important. The nondisturbed group in t 
study is exaggeratedly like the conformity 
controlled model child that is the aoaie A 
norm for the latency period. The fact that a 
nondisturbed sample was chosen by a 
teachers undoubtedly increased the pro i 
ability that a particular variety of the RA 
cietal ideal of normal latency a ar 
would constitute the sample. Perhaps ne 
expansive period of adolescence the gévianon 
in the direction of overcontrol are the “en 
pathognomonic than similar quantitative 
viations in the direction of impulsivity. 


Summary 


Forty children described as well-adjusted 
by their teachers were matched for nee a 
and IQ with children referred for child m T 
ance services to a large community clin a 
Each group contained 13 girls and 27 boyi 
The average age of both groups was a Bi 
over nine years, and the average IQ of bot! d 
&roups was a little over 120, The matche 
pairs were compared by means of the Ror- 
schach in the following ways: (a) total num- 
ber of objectively scored Ames danger signals 
out of a list of 13, (b) total number of ob- 
jectively scored Davidson adjustment sge 
out of a list of 13, (c) presence or absence 0 
individual Ames danger signals, (d) compara- 
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tive frequencies above the Ames 75th per- 
eee on determinants underlying the Ames 
am and (e) comparative frequen- 
2i elow the Ames 25th percentile for deter- 
inants underlying the Ames danger signals. 
4 pe onisturhed group was found to have 
Signals oi higher total of Ames danger 
he ee P difference between the two groups 
Reh st avidson adjustment signs did not 
Pe an significance, but was in the 
Eins ed direction. When the individual Ames 
TA p evaluated separately, only A% 
tisticall was found to discriminate at a sta- 
the y significant level. The difference was 
ie reverse of the expected direction, 1¢. 
with ier group had more members 
ate e high 4%. When comparative fre- 
25th ies above and below the Ames 75th and 
only "epee ear a e were evaluated, 
clinic e following differences between the 
be and the nondisturbed group were found 
liie statistically significant ($ < 05): fewer 
Bie, children with no m, fewer clinic chil- 
with with A% over 58, more clinic children 
ane a panees involving diffuse, dysphoric 
Reet and more clinic children having two 
iy of the latter type of response 
ger = author concluded that the Ames dan- 
vali oe do not have sufficient diagnostic 
ing c to make them useful for differentiat- 
er ie maladjusted and nondisturbed 
of ih es of eight- to ten-year-olds. Nearly half 
ent R: signs are either characteristically pres- 
5 inie a sizable proportion of both normal an 
A cases or else are almost never found in 
s rds of either. Several of the “danger 
actually tend to be found more fre- 


quently in normal records. However, the de- 
velopmental frame of reference underlying the 
signs was still seen as useful in interpreting 
the findings of the study. 


Received July 22, 1957. 
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An Investigation of Determinants Inducing Individuals 
to Seek Personal Counseling ** 


James S. Terwilliger and Fred E. Fiedler 


University of Illinois 


; attempted to identify some of 
ie anis which lead individuals to 
seek therapeutic help. Very few situations per- 
mit an adequate study of this problem. Gen- 
erally the counselor only sees people who 
feel the need for psychotherapy, while many 
others, equally maladjusted by various crj- 
teria, choose, for various reasons, not to con- 
sult a therapist. It is, therefore, of consider- 
able theoretical and practical importance to 
determine how those who seek counseling 
differ in important respects ‘from those who 
do not. 

Such a study was Possible at the Univer- 
sity of Illinois where the Student Counseling 
Service deals with students? educational, vo- 
cational, and personality problems, Students 
are urged to consult counselors if they, at 
any time, feel the need for professional help. 


Counseling services are Provided without 
charge. 


Sample. The subjects 
versity freshmen who liv 
racks which normally h 


Ss are assigned to the barracks in the order 
in which their application js received, 

On the basis of counseling service records, 
we identified a “counseling bureau group” 
(CBG) consisting of Ss who had visited the 
Counseling Bureau two or more times for per- 


1This study was conducted under Contract DA- 
49-007-MD-569 between the Office of the Surgeon 
General, Department of the Army, and the Univer- 
i linois. 
SA S ee report of this study may be ob- 
tained without charge from Fred „E. Fiedler, 427 
Gregory Hall, University of Illinois, Urbana, Illi- 
nois, or for a fee from the American Documenta- 
E + mstitüte. Order Document No. 5582, remitting 
Gu for microfilm or $1.25 for photocopies. 


(Ss) were male Uni- 
ed in temporary þar- 
oused 13 to 14 men. 


sonality problems (W = 10). Those who hag 
never consulted the bureau were placed in 
the control group (N = 87). se 
Tests. A number of personality and aaja 
ment measures were obtained from each i 
These included an abbreviated Taylor Ma i 
fest Anxiety Scale, a self-esteem score, a on 
ideal self discrepancy (or selt-sätisfacho K! 
score. Also obtained were sociometric er 
indices to provide a measure of the indivi K 
al’s acceptability to his peers, and nesr 
by others” scores from S’s fellow ae. 
who lived in the same barracks. This la i 
score indicates S’s adjustment as evan à 
by others. In addition, we also compute ans 
Grade Point Average, adjusted for S’s P 
formance in high school, se 
Results. Taylor anxiety scores, self-satis i 
tion, and self-esteem scores of Ss who ne 
sulted therapists differed significantly in dat 
maladjusted direction from those who did in 
consult a therapist. However, differences 
other scores were not significant. sous 
Discussion. As is to be expected, ee 
and less self-satisfied individuals are facie 
likely to seek therapeutic help than are t ‘a 
who do not express such feelings. In ele 
however, these Ss do not differ from the e 
trol group on objective or outside indices. i 
who consulted therapists were as well liked 
others, they were esteemed as highly, and Ta 
tended to have slightly better grades. Thes 
findings suggest that the client is brought mg 
therapy solely by subjective feelings of dis 


comfort with himself rather than by “te 
ality” factors, 


Brief Report. 
Received February 20, 1958. 
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Vocabulary as a Basis for Estimating Intelligence from 
the Rorschach ` 


Thomas R. Trier 


University of California, Berkeley 


ee estimate of intelligence is usually in- 
Rosi in the formulations made from the 
aa aa ‘Tt can be particularly helpful 
Pine re limitations or other considerations 
feran x impractical or impossible to adminis- 
and | eerie ag test, Beck (2) and Klopfer 
tried ged (3) are among those who have 
which S make more explicit the variables 
feiect should be considered in estimating 1- 
ae level. Beck states that intelligence 1$ 
and to Z, AJ, F + J, Ap, and number 
apoio’ of M responses. Klopfer and 
sho suggest that an estimate of intelligence 
uld be based on number and quality of 
vad oe and O responses, form accuracy level, 
Rees y of content, and succession of responses. 
Bost we seeking to determine whether the 
iy relationships between Rorschach 
Hine les and IQ do in fact exist has been 
Ka unsuccessful. Usually, when low, sig- 
a ar correlations between Rorschach fac- 
to ie IQ have been found, they have failed 
ee d up under cross-validation. The results 
i TAD by Armitage et al. (1) are typical 
Medii respect, but are particularly worthy of 
A ‘ee because of the large number of cases 
Ea, oyed. The authors computed the core 
W ons between 19 Rorschach variables and 
M eler Belleyue IQ for 503 patients. Low 
pu significant at the .01 level, were 
s ained for 13 of the variables. A multiple 
gression equation, based on the six variables 


S . 
howing the highest correlation with IQ, was 

x . 
wee: research was performed while the writer 
tration es trainee at the Veterans ACIUnS: 
© exp ospital, San Francisco, California. He wishes 
i vat ess his appreciation to David A. Rodgers for 
e e uable assistance in the design and analysis of 
xperiment and in the preparation of the article. 


computed. When this equation was applied to 
a new sample of 207 patients, it failed to 
improve the accuracy of estimates beyond 
chance. In contrast, judges were able to make 
fairly accurate estimates of intelligence when 
exposed to the total protocols. The authors 
suggest the possibility that the judges were 
responding to the quality of the vocabulary 
and the quality of the perceptual organization 
in making their judgments. 

The present study is an attempt to deter- 
mine whether the vocabulary in Rorschach 
protocols is a variable that can be profitably 
utilized in estimating intelligence. Wechsler’s 
statement, “. + - the size of a man’s vocabu- 
lary... isan excellent measure of his gen- 
eral intelligence” (6, p- 98); has been gen- 
erally accepted. Vocabulary subtests are in- 
cluded in many intelligence tests. In both the 
Stanford-Binet (4) and Wechsler-Bellevue 
(6), the vocabulary subtest correlates higher 
with total IQ than do any of the other sub- 
tests. If the extensiveness of a person’s vo- 
cabulary can be judged from the Rorschach 
with some accuracy, this measure might be 
useful in estimating his intelligence. 


Procedure 


Three groups, each consisting of four judges, 
were asked to make numerical estimates of 
Wechsler-Bellevue IQ. Judges in Group I were 
given 16 Rorschach protocols. They were 
asked to list the seven “most sophisticated” 
words from each protocol and to base their 
IQ estimates on these word lists. Judges in 
Group II were each given one of the four 
sheets of word lists constructed by the judges 
of Group I. They were informed how the lists 
were derived and were asked to make IQ esti- 
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mates using only the word lists. They differed 
from Group I in having no access to the total 
protocol. Group III judges were handed the 
sixteen protocols and asked to estimate intel- 
ligence from them. In contrast to the others, 
Group III judges were not given specific in- 
structions on what to base their judgments. 
In addition, an attempt was made to meas- 
ure the extensiveness of vocabulary in a more 
objective fashion. The four word lists con- 
structed by Group I judges for each protocol 
were pooled. While these word lists over- 
lapped considerably, pooling revealed that 
from 10 to 20 different words had been se- 
lected as “most sophisticated” for each proto- 
col by the four judges, 
These words were looked up in Thorndike 
and Lorge’s The Teachers Word Book of 
30,000 Words (5) to determine how fre- 
quently each word appears in everyday usage, 
A number that indicated how often each word 


sults reported by 
used a similar distribution, The pr 
male veterans who 
logical evaluation during hospitalization were 
selected from the files at San Francisco Vet. 
erans Administration Hospital. The tests had 
been administered examin- 
ers. Patients suspected of having organic 
brain pathology were excluded from the sam- 
ple. Only those.cases whose Rorschach proto- 
cols were scored by the Klopfer and Kelley 
system (3) were used. The age of the patients 
in the sample ranged from 19 to 67, with a 


Thomas R. Trier 


Table 1 


Rho Correlations Between the IQ Estimates of Judges 


and Wechsler-Bellevue IQ 


Judge Group I Group II Group III 
‘1 .79** .85** y“ 
2 BA hia Bie F: iad 
3 .74** .66** 64" 
4 .68** 63** .61* 


Ps Significant at or below the .05 level, 
Significant at or below the <01 level. 


mean of 38.4. The mean number of years of 
education was approximately ten. From 4 
diagnostic standpoint, the group was hetero- 
geneous and included psychoneurotic, psy- 
chotic, personality disorder, and psychoso- 
matic cases, 

The 12 clinicians used as judges all had ex- 
tensive training and experience in the use of 
the Rorschach and Wechsler-Bellevue. Most 
of them were graduate students nearing the 


completion of their Ph.D.s in clinical psy- 
chology, 


Results 


Correlation coefficients were used as indi- 
cators of the accuracy of judgments. In view 
of the tectangularity of the distribution, rank- 
order coefficients were employed. Table 1- in- 
dicates the correlations and the corresponding 
significance levels which were obtained by the 
Judges. Results for Groups I and II indicate 
that estimates of intelligence can be made 
ach Vocabulary. Since the ac- 
curacy of judges in Groups I and II is ap- 
Proximately the same, it does not appear to 
make any difference whether judges making 
their estimates from word lists have access to 
“ie Brotocols or not. Tt is to be noted that the 
Judgments based on total protocol are no 
More accurate than those based solely on the 
vocabulary, In addition, the estimates based 
on the Thorndike and Lorge word frequency 
count resulted in a rho of .77 (P < .01); 
Which is roushly comparable to the accuracy 
achieved by the judges. The results for Group 

are in agreement with those of Armitage 
et al. (1), who report a median correlation of 


69 for estimates based on evaluation of the 
total Protocols, 
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Discussion 


In comparison to the conventional Ror- 
—_ scoring variables whose contributions 
i ard estimating intelligence have been quite 
imited, vocabulary is a variable that im- 
eve accuracy of judgments considerably. 
9 rely solely on vocabulary in estimating 
e S simplify the task and might well 
The e most practical approach at present. 
tos results suggest that the clinician is not 
ndispensable for making the estimates. The 
icone could be submitted to a clerk who 
ses to select the rarest words from 

Protocol and to look them up in a word 

i eed table. After finding the seven most 

ommon words in each, he totals their fre- 

quencies and enters this total into an em- 

Prically derived equation or table, which 
Yields a numerical estimate of 1Q. 

iò he present investigation points the way 

ward areas of possible further research: 


ae a is quite likely that vocabulary could 
be evaluated from samples of verbal be- 
avior other than the Rorschach. Thus esti- 
Mates of intelligence might be made from the 
sige Apperception Test or from inter- 
S, possibilities first suggested by Armitage 
et al. (1), 
Dap Since the Thorndike and Lorge word 
30 image outdated and contains only 
? words, it is to be expected that if a 
more current and extensive word list could be 
Utilized, it would lead to somewhat more ac- 
aha estimates of IQ than those reported 
re, 
a 3. Since judges in Group III were not 
imited to specific cues in making their esti- 
Mates of IQ, it is impossible to determine to 
What extent their accuracy of judgment was 


due to reliance on vocabulary. It would be 
informative to determine whether comparable 
accuracy would be achieved when vocabulary 
is eliminated as a cue. This could be accom- 
plished by translating the protocols into basic 
English before giving them to the judges. 


Summary 


Three groups, each consisting of four judges, 
made estimates of Wechsler-Bellevue IQ from 
16 Rorschach protocols. One group used word 
lists which they constructed from the proto- 
cols, another used word lists derived by others 
from the protocols, and the third used the 
protocols without instructions to focus on vo- 
cabulary. In addition, estimates were made 
in a more objective fashion using the Thorn- 
dike-Lorge word frequency count. The three 
groups and the objective approach achieved 
fairly comparable accuracy. Results suggest 
that IQ can be estimated as well, using only 
vocabulary, as by any other approach cur- 
rently in use. 
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Extraversion, N curoticism, Radicalism, 
and Tendermindedness' 


A. W. Bendig 


University of Pittsburgh 


Eysenck (2) has stated that the person- 
ality trait of Extraversion is negatively re- 
lated to the socjal attitude dimension of Ten- 
dermindedness, but is not related to the atti- 
tude trait of Radicalism. Neuroticism js not 


variables, 
The Maudsley Personalit: 
taining scales of Extraversion and Neuroti- 


Sex groups 
showed the female Ss to be more 


minded” than the male Ss, but the differences 
on the other three scales were not statisti- 
cally significant. 

Product-moment correlation Coefficients 
among the four scales were Separately com- 
puted within each sex &roup and the pairs of 
correlations tested for significant Sex differ- 
ences by the r-to-z method. The Correlations 


1 An extended report of this study may be ob- 
tained without charge from A. W. Bendig, Dept. of 
Psychology, University of Pittsburgh, Pittsburgh 13, 
Pa., or for a fee from the American Documentation 
Institute. Order Document No. 5578, remitting $1.25 
for microfilm or $1.25 for photocopies. 


were averaged when these tests did not api 
proach significance. The average correlation 
between Extraversion and Neuroticism (r = 
— 12) was significant at the .10 level, but 
the correlations of Extraversion with Radi- 
calism and Tendermindedness were not sig- 
nificant (r = — 04 and — 01). The average 
Correlation between Neuroticism and Radical 
ism (r = .22) was significant at the .01 ee 
and similar in both sex groups (r = .18 an 
.26). The Correlations of Tendermindedness 
with Neuroticism and Radicalism were signifi- 
cant for the male Ss (r = — 28 and — 19), 
but not for the female Ss (r = — .03 and 08), 
and the sex differences in these torrela uona 
were significant at the -10 level (z = 1.79 an 
105). . i 

These results indicate that Eysenck’s link- 
ing of Extraversion with Tendesmindedns 
and Cattell’s association of Extraversion an 
Radicalism were not confirmed by the er 
However, Cattell’s hypothesized relation © 
and Radicalism did appeat 
within both sex groups of Ss. The sex dif- 
ferences among the Correlations of Tender- 
mindedness With Radicalism and Neuroticism 
may represent either a sampling fluctuation 
or a different Organization of these three 
traits in men and women Ss, 


Brief Report, 
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Handwriting Conventions as Determinants 
of Human Figure Drawings’ 


Wayne Dennis 
Brooklyn College 


ee theorists have suggested inter- 
aeos for many aspects of human figure 
eg among them the position of the 
ae (2 upon the page. Thus, Karen Mach- 
drawin ) proposed that the location of the 
läte & toward the right side of the page in- 
ented that the subject is environment-ori- 
istic ne a left-side location is character- 
ón T a self-oriented person. A drawing high 
Banino, page is related to optimism, a low- 
itioned drawing suggests depression. Levy 
agg oPosed that drawings on the left of the 
Bion ane self-consciousness or introver- 
ee oward the right, rebelliousness. For 
pan the use of the upper half of the page 
achie €s striving toward high standards of 
ings aa whereas persons who place draw- 
°° toward the lower edge of the sheet are 
cha to be stable, firmly rooted, or, in some 
are x depressed. That these interpretations 
SA ased upon resemblances in meaning be- 
ai n words used to describe space (high, 
alit, etc.) and words used to describe person- 
Y (elated, depressed, etc.) seems obvious. 
4 ether such linguistic resemblances provide 
Valid basis for hypothesizing relationships 
ee drawings and personality has not as 
et been adequately determined. 


1 ry 
feet wish to express our appreciation to the Leba- 
data f 8yptian, and American schools who provided 
ere or this study. The Egyptian and Lebanese data 
isitetthered in 1956-1957 when the author was â 
diit Professor at the American University of 
ere 4 and the gathering and analysis of these data 
roth Ported by a grant from the Rockefeller 
Urani e Fund. Special thanks are due to Habib 
Versit: y aud E. Terry Prothro of the American Uni- 
ageman of Beirut for their cooperation and encour- 
for ¢ nt and to Evelyn Raskin of Brooklyn College 
onsultation and suggestions. 


Vi 


Whatever may be the final decision in re- 
gard to the relationships between personality 
and graphic expression, it seems likely that 
not all of the variance present in drawings 
will be accounted for by individual differences 
in temperament and personality, There may 
be determinants of drawing position which 
are cultural and which have little if any rela- 
tionship to personality. Culture determines the 
position on a page at which a person begins 
to write. If there is a habit-transfer between 
writing and drawing, the position of draw- 
ings will be affected by handwriting habits. 
This study examines the drawing location of 
two classes of writers; namely, those who be- 
gin to write at the top left of the page and 
those who begin to write at the top right of 
the page. 

Method 
Subjects 

The writers who start at the top left of the 
page are represented by two subgroups, those 
writing English and those writing Armenian. 
In nationality, these Ss are Americans and 
Lebanese, respectively. Those starting at the 
top right of the page are Arabic writers. Their 
nationalities are Lebanese and Egyptian. All 
are children in elementary schools between 
ages five and ten. 

The American Ss come from three widely 
separated localities: (a) a small town in 
Maryland, (b) a small town in Kansas, and 
(c) a suburban town near New York City. 
The Armenian Ss attended two schools in 
Beirut, Lebanon. The Ss coinprised either 
complete samples or random samples from 
their respective schools. The total number of 
Ss in the above groups was 1,075. 
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of the Arabic-writing Ss were attend- 
A e public school in Port Said, Egypt. An 
others were attending public or private schools 
in Lebanon. These two groups totalled 651 
Ss. These Ss, like the Armenian and Ameri- 
can groups were, so far as could be deter- 
mined, representative of their schools. 


Testing and Scoring Procedures 


The drawing test employed was the Good- 
enough draw-a-man test. Goodenough s in- 
structions were followed. All drawings were 
made in pencil on 84” by 11” white paper. 

In scoring each drawing for the purposes of 

the present study, it was indicated, first, 
whether the topmost part was nearer or the 
bottom-most part was nearer their respective 
edges of the paper. Second, it was noted 
whether the left or right side of the drawing 
(left and right being designated from the ob- 
server’s point of view) was nearer the lateral 
edges of the page. In judging the vertical lo- 
cation, the most extreme part of the drawing, 
such as the top of the hat or a projecting 
feather, was used. However, right and left 
judgments were based upon the most lateral 
parts of the body, excluding the extremities. 
In those drawings which lacked a body, judg- 
ments were based upon the head. When there 
was any doubt as to the judgments, measure- 
ments were made. When two measurements 
were identical, which seldom occurred, scores 
were assigned alternately to the two cate- 
gories. 


Results 
In terms of the scoring method just de- 
scribed, a drawing must receive one of four 


Table 1 


Position of Figure Drawings on a Page 


Armenian- 

Location American Arab 
Top left 48% 24% 
Top right 16% 48% 
Bottom left 27% 14% 
Bottom right 9% 14% 
N 1,075 651 


Wayne Dennis 


scores: top left, top right, bottom left and 
bottom right. Top left means that the draw- 
ing was nearer the top of the paper than to 
the bottom, and nearer the left edge than E 
right edge. The other terms have correspond- 
ing meanings. , 

Table 1 shows the percentage of drawings 
falling into each category for each of the 
groups. 4 

Table 1 shows that in the Armenian-Ameti- 
can group, 48% of the drawings have a top- 
left position, whereas in the Arab group, 48% 
fall in the top-right group. 


Discussion 


Obviously, these findings are in accord with 
the habit-transfer hypothesis suggested ear- 
lier. Also in accord with this interpretation d 
the finding that 64% of the Armenian aa 
American drawings and 72% of the Aral 
drawings are nearer the top of the page than 
they are to the bottom. a 

However, while all Armenians and amea 
cans begin to write in the top-left portion T 
the page and all Arabic-writing Ss start na 
handwriting in the top-right quadrant, pol as 
members of these groups place their drawing 
in the corresponding positions. Handwriting 
customs appear to have some influence 3 
producing differences between certain group i 
but they cannot, of course, explain the within 
group variability. While the data here pr¢ 
sented are consonant with the handwriting 
hypothesis, they are not entirely conclusive. 
The two groups compared no doubt differ i 
other respects as well as in regard to hand- 
writing. It is unlikely that one can find m 
groups differing in handwriting but identica 
in all other respects, However, if one were : i 
find that many groups differing in handwrit- 
ing also differ in a consistent way in location 
of drawings, our hypothesis would seem to ne 
firmly Supported. Until a wider sampling ° 
groups is obtained, the data here presented 
should serve as a caution in regard to inte! n 
preting cross-cultural differences in drawing 
locations as indicative of differences in per- 
sonality. Such differences may be the result 


Handwriting Conventions and Human Figure Drawings 


of habit patterns having little relationship to 
emotional or social traits. 


Summary 


Evidence has been presented which is con- 
sonant with the hypothesis that the location 
of drawings depends in part upon whether 
subjects in writing their primary language be- 
gin at the top left or top right of the page. 
Further comparisons of other language groups 
are needed to test the hypothesis, but, mean- 
while, caution in the interpretation of cross- 
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cultural differences in location of drawings is 
indicated. 
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The Relationship Between Edwards’ and McClelland’s 
Measures of Achievement Motivation‘ 


Levon H. Melikian 


American University of Beirut 


Independent measures of achievement mo- 
tivation have recently been developed by Ed- 
wards (1) and McClelland et al, (2). Ed- 
wards’ measure of this variable is one of fif- 
teen that have their origin in, and bear the 
same names as, a list of manifest needs pre- 
sented by Murray (3). They form the Ed- 
wards Personal Preference Schedule which 
measures a “number of relatively independent 
normal personality variables” (1, p. 1). Mc- 
Clelland’s method of measuring n Achieve- 
ment is also rooted in Murray, since he uses 
imaginative stories evoked by two TAT cards 


ed by him and 
ped a quantita- 


Since both Edwards and McClelland inde- 
pendently measure the Same variable, a high 
correlation is expected between the scores ob- 
tained on their two measures. The purpose of 
this study is to test whether such a relation 
exists or not. 


Method 


The subjects (Ss) in this experiment were 
84 Arabic-speaking students in two psychol- 
ogy classes at the American University of 
Beirut. Approximately half of the Ss were 
citizens of Lebanon, and the other half came 
from Jordan, Syria, Iraq, and Bahrain. All 
the Ss had a good command of English, which 
is the language of instruction in the Univer- 
sity. Sixty of the Ss were males. 


wi his indebted- 
1 The author wishes to acknowledge r 
Se Aimee Sabbagh and Sumaya Kurani, of the 
Department of Psychology, for scoring the imagina- 
tive stories on the McClelland Test. 


The full PPS was administered to the 
as a class demonstration in the use of 
questionnaire method. The Ss were told ni- 
E was interested in collecting norms on Her 
versity students for help in his counse a 
work and were also told that these the 
would be available to the class members. a 
Ss were told to use a private iene 
mark on their answer sheets and were as ur 
to keep a record of it, A week later the a 
Pictures used by McClelland were projec ts 
on a screen, and each § was given four ie 
of paper, on each of which were panten nd 
four standard questions used by McClel T 
about the pictures which the Ss were as 
to answer, The instructions and method 7 
by McClelland (2, p. 98) were ee 
throughout. The Ss were asked to use n 
same identification mark they had used A 
the PPS the week before. This was also p” i 
sented to the class as a demonstration of pE 
jective tests which were to be discussed du e 
ing the following class session. Both thes 
tests were given under similar conditions, 4? 


the situation approximates McClelland’s “neu- 
tral” condition 


The t 
method 


assistant 


relation was ‘93, which is considered to be 
Satisfactory, Only the 69 Ss, 50 males and 1 
emales, wh 


© completed both tests were a 
in the final analysis. The age range f0 
the 68 Ss who had indicated their age (08 
their last birthday) was 18 to 29, with a 
mean of 21.1 and a standard deviation of 2.2: 
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Results and Discussion 


_ Table 1 shows the means and standard de- 
viations on Achievement for our Ss and those 
of Edwards. The difference between the two 
Means is not significant, ¢ being .52, which 
oe the probable validity of this ques- 
ae aire for a non-American culture. To 

erify this, the Achievement items on the 
in ge presented to three Arab professors 
an e fields of psychology, Arabic history, 
and Arabic literature. They were asked to 
eee whether any of the items were in any 
they alien to the Arabic culture and whether 
se sa be taken as indices of achievement 
Sa > Arab group. There was full agreement 
it ong the judges about the validity of these 

ems for an Arabic-speaking culture. 

es mean score of the Ss on the imagina- 
fe Stories was 2.22 with a standard devia- 
abl of 4.26. No comparable data are avail- 
ee for American groups. Even though such 
aan is not available, a glance at the 
oan of the different categories of 

levement scores in Table 2 points to the 
er bility of cultural differences on certain 
in €gories. These differences will be discussed 
hes: Separate paper as they are not directly 
= ated to the present study. Evidence regard- 

& the cross-cultural validity of the scoring 
Method used is presented by McClelland (2, 
PP. 168-172), 

The correlation between the scores of the 
th Ss on the PPS achievement variable and 

Xe McClelland achievement scores is .16. 
aa an r of .16 is not significant, it indi- 
i es an absence of a relationship between 
Wo methods that claim to measure the same 
Variable, 

E ke all motives, the achievement motive is 
cather complex. McClelland (2, P: 217) de- 

Cribes his score as that of a “composite index 


Table 1 


Mean Achievement Scores of Arab and American® 
Subjects on the PPS 


Group N Mean SD 

Arabs 4.26 
84 14.65 . 

Americans 1509 14.38 4.36 


a 
U. S, scores taken from Edwards (1, p. 6). 


Table 2 


Frequencies of Various Achievement Categories* under 
Neutral Experimental Conditions for Both Arab 
and American Subjects® 


Achievement category Americans Arabs 


Achievement Imagery (AI) 75 70 
Doubtful Imagery (TI) 49 102 
Unrelated Imagery (UI) 49 112 
Need (N) 35 25 
Instrumental Activity (I) 31 33 
Positive Anticipatory 

Goal State (Ga +) 25 14 
Negative Anticipatory 

Goal State (Ga —) 20 12 
Personal Obstacle (Bp) 8 8 
Environment Obstacle (Bw) 17 10 
Positive Affect State (G +) 17 16 
Negative Affect State (G —) 23 13 
Nurturant (Nup) 5 5 
‘Achievement Theme (Ach. Th.) 62 58 


a The total number of stories for the Arab group is 276 (69 Ss, 
4 stories each); and for the American group is 156 (39 Ss, 4 


stories each). 
b Data on the American S is taken from McClelland (2, p. 


141). 


of a variety of types of achievement motiva- 
tion” which he demonstrates as having a 
meaningful relationship to varied types of 
behavior. Among the theoretical distinctions 
which he makes between different types of 
achievement is one type that is characterized 
chiefly by a “hope of success” and another 
by a “fear of failure” (2, p. 215). 

This theoretical distinction may possibly 
account for the absence of a relationship be- 
tween the two measures. An inspection of the 
PPS items which measure achievement mo- 
tivation shows that they refer to competition 
with some standard of excellence similar to 
the “hope for success” type of achievement. 
“To do one’s best, to be successful, to accom- 
plish . . . to do < e ; torsolve.. +: todo 
things better than others ... etc... .” are 
given by Edwards (1, p. 5) in describing his 
Achievement variable. 

Besides the above, responses to the Ed- 
wards items are made to clearly structured 
stimuli, whereas the imaginative stories are 
responses to a variety of cues both internal 
and external, in the environment and the pic- 
tures, as well as to experimentally induced 
cues. This difference points to the probability 
that the two measures tap different levels of 
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achievement, a manifest level, and a latent 
level (2, pp. 196-217), and may account for 
the absence of a relationship between the two 
measures. 

In the light of the findings, and in the in- 
terest of avoiding confusion, it is suggested 
that the two measures of achievement motiva- 
tion be either renamed or qualified. 


Summary 


‘The PPS and the McClelland pictures for 
measuring achievement were given a week 
apart to a group of 84 Arabic-speaking Ss at 
the American University of Beirut. No rela- 
tionship was found between the achievement 
scores of the 69 Ss who completed both tests. 


Melikian 


The results were discussed in terms of the 
complexity of the achievement motive and, 
also, of the probability that the two methods 


measure the achievement motive at different 
levels. 
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Second-Order Factors in Personality Measurement 
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and Kenneth B. Pool** 


University of California, Berkeley 


fb surprising that to date so few pub- 
= studies on the Sixteen Personality Fac- 
not Questionnaire have appeared which have 
alit af nen from the Laboratory of Person- 
The : ssessment at the University of Illinois. 
een for this lack of popularity are not 
as y apparent, since Cattell and his co- 
(3 +. have published widely and frequently 
much 5, 7, 8). Karson and Pool (11) found 
MM similarity between the 16 P.F. and the 
IPI which they interpreted as offering Sup- 
a for the construct validity of the 16 P.F. 
the Their major criticism of the test was that 
Fo coefficients of equivalence of the factors on 
tö rms A and B were not nearly high enough 
aaay their being used as equivalent forms, 
fen that even after being corrected for full 
fo gth with the Spearman-Brown prophecy 
a a the resultant coefficients of half of 
‘a 16 factors were still not high enough to 
S arrant their use for accurate individual per- 
Onality description. 
a a recent paper, Cattell (5) reported 
i r second-order personality factors which he 
entified as Anxiety-vs.-Dynamic Integration, 
Di aoe oe onan Cyclothyme-vs- 
ce izothyme Constitution, and Unbroken Suc- 
oe These findings were = 
of sample of 408 normal subjects compose 
ae: undergraduate students of both sexes 
i 227 U.S. Air Force young men 1P train- 
8- The aim of the present study was to at- 


1 
Rese data for this study were collected and os 
c rE computed while both authors were at the 
3 e Aviation Medicine, USAF. er 
at marized version of this paper WaS P t 
by ‘th 1957 meetings of the APA in New York City 
e senior author. 


tempt to replicate the second-order factors de- 
scribed by Cattell in order to determine the 
degree of stability of these factors over differ- 
ent samples. From a theoretical viewpoint, if 
different samples resulted in yielding unre- 
lated factor structures, then the argument (4, 
p. 3) that factors actually correspond “to psy- 
chological functional unities rather than to 
mere mathematical conveniences” would be 


highly questionable. 


Sample 


The sample consisted of 71 USAF officers 
who were referred to the School of Aviation 
Medicine for medical and psychological evalu- 
ation. The average age was 33, with a range 
of 20 to 39 years, and the mean number of 
years of education was 14, with a range of 12 
to 16 years. The mean Full Scale IQ on the 
Wechsler Adult Intelligence Scale was 121.98, 
with a standard deviation of 6.50. The pa- 
tients were referred for evaluation between 
August, 1955 and July, 1956. The sample em- 
ployed in this research is believed to be typi- 
cal of the flying personnel who are referred 
for psychiatric consultation in the US. Air 
Force. 

None of the patients was psychotic, but 
almost all were manifesting some disturbance 
in functioning efficiency which was impairing, 
at least temporarily, their ability to perform 
their duties as USAF flying personnel. Upon 
clinical examination, which included psychi- 
atric and psychological evaluation, there was 
general agreement that anxiety and its dis- 
rupting effects usually played a key role in 
the etiology of the patients’ symptomatology, 
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Samuel Karson and Kenneth B. Pool 


Table 1 


Intercorrelations* of Factor Scores on the Sixteen PF. Test 
Forms A and B Combined (N = 71) 


come ce zr © E fF Bee O p ma a 
> 11 
2 10 45 12 07 08 12 07 01 —.27 —.08 . 
$ sie i ao =08 A 02 21 s =- of =i 02 —15 E 
Z 222 20 aT AL = sy) 03 71 -4 —<13 43 e 
g ai = 03 a a O a 19) 20 =k SHS 4 
E —20 66 —23 —14 —14 12 —28 =02 =16 —.19 “i 
A Q8: 16 23 03 —07 (00 07 26 Ta 
S —.26 —.23 —.27 18 —52 —17 —.36 05 yi 
A -20 45 —.23 40 04 16 —.09 a 
i -52 00 46 2 2 —18 33 
M —13 S6 3A 2 =36 s 
=i8 ii ol -03 —-2 
o a 23 -a M 
o 24 —.16  : 
Qı w 
Bs 42 
Qs 
Q; 


* For significance at the .05 level of confidence a Pearson r must equal .24, 


even though an actual incapacitating, diag- 
nosable neurosis was seldom present. It should 
be remembered that the sample was composed 
of mentally and physically superior experi- 
enced military flying officers, many of whom 


had successful combat records in either World 
War II or Korea, 


Method and Results 


The 16 P.F. test (Forms A and B) was ad- 
ministered as a Part of the routine diagnostic 
psychological test battery. The two forms of 
the test were alternated so that about one-half 
of the sample took Form A first, while the 
other half had Form B initially. Both forms of 
the test were usually administered on the same 
day, one in the morning and the other in the 
afternoon. The tests were scored according to 
the directions given in the handbook. The raw 
scores were converted into standard scores by 
using the sample of male college students and 
high school seniors whose average age Was 21 
as the reference group. Pearson coefficients of 
correlation among the standard scores for the 
16 factors were computed to achieve the ae 
trix of intercorrelations presented in Table 1. 


3 Although this procedure for obtaining the matrix 
f intercorrelations is admittedly not as precise as 
Aca begins with the cosine matrix among the 
ks eon «ame primary factors and then inverts this 
mae oe obtain the correlations among the factors, 


The factor analysis was then done, veng 
Thurstone’s centroid method (12). As guide 
for when to stop factoring, criteria suggeste d 
by Burt and Banks (1) and Guilford a 
Lacey (10) were used. After six factors i 
been extracted, an estimated 109% of 
common factor variance had been: account in 
for, and the sixth factor residuals ranged a 
size from — .068 to .093. Rotation to simp 
structure was then attempted without regar 
to positive manifold. As a guide in rotation, 
the goal was to maximize the number of Mo 
ables with zero Projections on the referenci 
vectors. The factors were rotated blindly eis 
at a time by means of graphs and six in ie 
pendent, second-order factors were extracted. 
The new factor loadings and their communali- 
Tes dis 

Cattell has previously employed this method (4, P 
18). On this same issue, Cattell (5, p. 412) states: 
“However, it must be granted that where factors are 


already very purely measured by existing tests, wit 
no systematic bias and 
peer factors in 
actual factor sc 
factor, 


may yield a reasonable approximation tO 


is seems to have happened 


r 
No. 5586, remitting $1.25 f0 
photocopies. 


Second-Order Factors in Personality Measurement 


Table 2 
Rotated Second-Order Factor Loadings 


First 

order 
factor I II Ill IV v VI h? 
A 03 51 09 34 .10 —.02 .3951 
24 03 38 —.10 .03 —.07 .2187 
a —.84 24 .27 —.17 05 —.08 .8739 
= —.04 54 —02 —33 04 —.37 .5410 
—11 75 04 —.02 .20 —.03 .6175 
G 03 —06 —.08 01 —.61 08 .3895 
H ~33 g4 —04 19 —16 .00 .8778 
E 32 —.23 —.01 .03 —.09 .60 .524 
65 —.02 .00 —.08 —.41 —.08 .6038 
M z o2 00 —.23 -04 532 6757 
N -07 11 —30 07 01 —.27 .1849 
O 81 —34 18 12 09 .09 8347 
Q 34 02 —47 —17 —.02 —.05 .3687 
a 21 —23 —05 —47 —.26 —.01 3881 
OQ: ~54 —19 03 O01 —34 04 .4459 
a 80 —06 21 19 —.04 —.04 .7270 


ee ee eee 


ties after rotation of axes are presented in 
Table 2, 


Description of the Factors 


t The chief indications of the nature of Fac- 
oh 1 through 6 are presented below with a 
Ontingent title given to each factor. 


Factor 1. Anxiely-vs.-Dynamic Integration 


Symbol 16 P.F. Handbook Title Loading 
Cc g — 84 
o go Strength ‘g1 


Anxious Insecurity 
Q: Nervous Tension y 
Hysteric Unconcern 2 
0 Paranoid Schizothymia y 
0 Will Control & Character Stability oi 
A Radicalism 3 
T Adventurous Autonomic Resilience 3 
Emotional Sensitivity 


the his factor shows a marked resemblance fo 
(5 Second-order factor reported by Cattell 
heayin, h Qs, 0, Qs L C, and H loade 
Ws. Yy. He identified this factor as sae 
his ale Integration and we have adopte 
-> title. Further support for this identifica- 
attel forthcoming from an earlier study bY 
3S An {4) in which a factor described by T 
The © Ys: Self-Assuredness was reported. 
and Hy ah Ee test factors, Qs, O, O» C, L, M, 
ditional sar ee mat d by Karson 
support is provide 
ool (11) who reported that the MMPI 


ion 
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psychasthenia (Pf) scale correlated signifi- 
cantly with factors C, O, Qa, M, L, Qs, H, 
and Z. Moreover, the factors with significant 
loadings on Factor 1 correlated more highly 
with the Pż scale than any of the other 13 
MMPI scales, with the possible exception of 
Sc which correlated .89 with P# for the pres- 
ent sample (11). High correlations between 
Pt and the Taylor Anxiety scale have been 
reported by Eriksen and Davids (9) and by 
Brackbill and Little (2). 


Factor 2. Extraversion-vs.-Introversion 


Symbol 16 P.F. Handbook Title Loading 
H Adventurous Autonomic Resilience 84 
F Surgency +15: 
E Dominance 54 
A Cyclothymia „51 
oO Anxious Insecurity —.34 


Factor 2 also shows much similarity to 
another of Cattell’s second-order factors on 
which M, F, A, Qı, Q2, and H had significant 
loadings. He identified this factor as Extra- 
version-vs.-Introversion, and once again we 
have adopted his title (5). Cattell reports 
that in still another study (5, P- 416) the E 
factor (which we found) also enters in and, 
moreover, that an alternative rotation which 
was considered for his Factor 2 on 4 would 
also have done so again. The reasons why Qi 
did not load on Factor 2 in the present study, 
while O did, are unknown, although it is be- 
lieved that sampling differences may be re- 
sponsible for these variations. 

Karson and Pool (11) provide additional 
support for the identification of Factor 2 in- 
asmuch as they reported significant correla- 
tions between certain 16 P.F. scores and 
particular MMPI scale scores which appear 
relevant to this identification. 

The present findings do not, however, sup- 
port Cattell’s assertion (5, p. 416) that the 
“relatively low loadings of the more heredi- 
tarily determined H and A factors suggest 
that Factor 2 is an environmentally deter- 
mined pattern.” Factor H had the highest 
loading of all in the present study. Neverthe, 
less, his conclusion (5, P- 417) that ‘There 

d for recoguizing extraver- 


now seems groun y 
sion-introversion as something more than a 


correlation cluster OF surface trait, and per- 
haps for specializing the term for this measur- 
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able second-order factor” is in agreement with 
the present findings. 


Factor 3. Unbroken Success-vs.-Frustration 


Symbol 16 P.F. Handbook Title Loading 
Qı Conservatism —.47 
B General Intelligence -38 
N Lack of Sophistication (Naivete) —-30 
G Ego Strength .27 


Factor 3 shows some resemblance to Cat- 
tell’s factor of Unbroken Success-vs.-Frustra- 
tion inasmuch as Q, and N are present in 
both patterns as well as high intelligence from 
an objective behavior study (5, p. 417). 

Karson and Pool (11) demonstrated, how- 
ever, that for the present USAF officer sam- 
ple, Factor B was not a valid measure of 
intelligence. They also reported significant 
correlations between B and Mf and L, re- 
spectively, and between Qı and F, Hy and 
Mf from the MMPI. This pattern of relation- 
ships makes Factor 3 difficult to identify. The 
n to adopt Cattell’s 
-vs.-Frustration, al- 
of Spontaneity-vs,- 
Inhibition was also entertained. 


Factor 4. I, ndependence-vs.-Dependence 


Symbol 16 P.F. Handbook Title Loading 
Q: Lack of Resolution —.47 
Cyclothymia 34 
Lack of Dominance (Submission) —.33 


Factor 4 has some 
order factor (4, p, 40) of Sc 


» with a more 
recent second-order factor again identified by 


Cattell (5, p. 417) as Cyclothyme-vs.-Schizo. 
thyme Constitution on which Factors 4, 1, 
N, Qs, and C loaded significantly, 

Karson and Pool (11) reported significant 
correlations between Qs and Si and Mf, be- 
tween A and Si, and between E and Mj, Si, 
and Sc, respectively. In view of this Pattern 
of interrelationships, Factor 4 has been tenta- 
tively identified as Independence-vs.-Depend- 
ence. The handbook (8) for the 16 P.F. lends 
support for this hypothesis by its description 
of the Qz — person (8, p. 11), the A — ang 
A + person (8, p. 6), and Factor E as wel 


(8, p. 7). 


Samuel Karson and Kenneth B. Pool 


Factor 5. Sociopathic Deviancy 


Symbol 16 P.F. Handbook Title Loading 
G Lack of Super-Ego Strength y E 
L Lack of Paranoid Schizothymia E 
Q: Lack of Will Control e 
Q: Lack of Resolution -e 


The identification of this factor is especially 
difficult, Principally because the two mei, 
with the highest loadings, namely G and L, 
are among the ones about which least i 
known. Karson and Pool (11) reported tha 
none of the MMPI scale scores correlated = 
nificantly with Factor G which, stag 1 
enough, had its highest correlations with : 
and K. These findings as well as the authors 
clinical experience with this test over a two- 
year period raise some doubt as to the identi- 
fication of G as a factor of “effective” a 
ego pattern (6). Factor L is also puzzling; Í 
did not correlate with Pa; however, it corre- 


lated more highly with P£ and Sc than did Pa, 


Moreover, the high loading of L on the ot, 
ond-order factor of Anxiety-vs.-Dynamic w 
tegration, which has been found consistently 
(4, 5, 7), does not appear to have been B 
factorily explained on a theoretical basis ya 
though such an explanation has been @ 

tempted (7, p, 230). 

Two hypotheses are suggested for he 
identification of Factor 5; first, that it fs 
factor of sociopathic deviancy and, ane 
that it represents a lack of obsessive-compur 
sive personality characteristics in our sample- 
The latter interpretation would necessitate 4 
reexamination of Factor Z with emphasis 
given to its anxiety and rigidity aspects rather 
than to paranoid Suspicion. At any rate, it 1 
encouraging to see some relationships emerge 
between the highly esoteric world of factor 
analysis and the More familiar conceptualiza- 
tions of Psychiatric nosology. 


Factor 6, Latent Homosexuality (Passive) 


Symbol 16 P.F. Handbook Title Trading 
T Emotiona] Sensitivit A 
D I oA 
E Lack of Dominance (Submission) =f 
M Hysteric Unconcern a 
N Lack of Sophistication (Naivete) a4 


The particular co 
this factor suggests 
homosexuality ofap 


nstellation of loadings = 
the hypothesis of laten 
assive nature. Some sup- 


Second-Order Factors in Personality Measurement 


port for this identification comes from the sig- 
nificant correlation reported between J and 
Mf (11) and from the description of the J + 
person presented in the 16 P.F. handbook (8, 
oh This factor may serve to throw light on 
a A Ae a of military flyers, par- 
di larly with regard to the frequently made 
a observation of “masculine strivings” 
or this group. 
Aa mention should be made of the fact 
ae ‘attell (5) used an oblique solution in 
ie sm the four second-order factors which 
E embed while the present study reports 
Withst ependent factors. These differences not- 
be i anding, the present findings appeat to 
aaa agg for those who believe in the 

ility and reality of factorial solutions. 
white two of Cattell’s factors correlated 43, 
Sant the same two factors were not signifi- 
saat, correlated in the present study, is not 
ia ily apparent although this discrepancy 
ae be a function of methodological differ- 

€s, sampling differences, or both. 


Summary 


fost order to evaluate the stability of fac- 
te solutions over different samples, an at- 
™pt was made to replicate the second-order 
Personality factors reported by Cattell. Forms 
+ and B of the 16 P.F. were administered to 
‘one of 71 USAF officers on flying status, 
tion had been referred to the School of Avia- 
a Medicine, USAF, for medical and psy- 
ological evaluation. The test scores were 
ieee on IBM cards, and a correlation 
tie was derived using Pearson product- 
an E correlation coefficients. The factor 
met ysis was done using Thurstone’s centroi 
the; hod. Rotation to simple structure by 
ee of graphs yielded six orthogonal, sec- 
gee personality factors. These were de- 
nt ed as follows: 1. Anxiety-vs.-Dynamic 
egration; 2. Extraversion-vs.-Introversion ; 
De Unbroken Success-vs.-Frustration; 4. Inde- 
i dence-vs.-Dependence; 5. Sociopathic De- 
The 2: 6. Latent Homosexuality (Passive) 
e first three factors named above appear to 
© replications of three of the four second- 
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order factors reported by Cattell and his titles 
for them were used. The remaining differ- 
ences in the nature and number of second- 
order factors found between the two studies 
can probably be explained at least partially 
by methodological differences, by the varying 
degree of simple structure actually attained, 
and by differences in age, status, and sex as 
well as in the personality characteristics of 
the two samples. 
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The MMPI Performance of Veterans with Organic 
and Psychiatric Disabilities! 


Joseph J. Motto 


Detroit Regional Office, Veterans Administration 


The purpose of this Paper was to investigate 
the Minnesota Multiphasic Personality In- 
ventory (MMPI) performance of two groups 
of disabled veterans to determine whether 
there were areas of significant difference in 
terms of personality functioning. Particular 
attention was devoted to the K correction 
scale to determine if significant differences 
existed in the “test-taking attitude” of veter- 
ans with psychiatric as compared to those of 
organic disabilities, 

The setting of the study was a VA coun- 


seling service for seriously disabled veterans. 
The Ss consisted of 


having VA ratings f 
shot wounds and a 
with VA ratings fo 


three years. 

The MMPI scores of the Psychiatric (P) 
group were compared with the organic (O) 
group, and both of these groups were com- 
pared with the MMPI standardization group 
on several of the scales, and with a group of 
nondisabled “normal” veteran controls, 

Examination and statistical analyses of the 
data revealed the following: 


1An extended report of this study may be ob- 
tained without charge from Joseph J. Motto, 8635 
ee Detroit 4, Michigan, or for a fee from the 
Elmira, Documentation Institute. Order Document 
Le poms remitting $1.75 for microfilm or $2.50 for 
o. n 


photocopies. i 


1. MMPI scales, Pt and Sc, significan 
differentiated those of organic disabili 
from those of schizophrenic disabilities. de 

2. In terms of personality characteris ia 
measured by the MMPI, the organic gro i 
was more similar to the psychiatric a d 
than they were to a group of nondisabled, 
“normal” veteran controls. R 

3. The presence of an organic disability ifi- 
sulted in Hs scores which were not signi 2 
cantly higher than those produced by the psy 
chiatric group, ; 

4. The K Ral functioned as predicted wy 
test authors and conformed to their Bes, 
of the suppressor variable when applie and 
those with organic disabilities, the sole exceP 
tion being the Mf scale where it appears 4 A 
Correction weight is needed for this ira 
similar trend to an inverse relationship 
tween K and Mf was seen in the P group. for 

5. There were indications of the need i 
an additional K Correction weight for he a 
ans with psychiatric disabilities on Sc, M4, 
and Pa scales, th 

6. Compared to the control group, bo 
disability groups Produced higher F scores. 
The organics differed from the normals by 
the presence of an elevated neurotic triad, 
Whereas the Psychiatric group differed from 
the normals by elevations of both the neu- 
Totic and the Psychotic triads. 

7. K was found to have a high positive re- 
lationship with Z and a significant inverse re- 
lationship with F, 
Brief Report, 

Received March 10, 1958. 


304 


Sa ee a Ear A 


r 
i 

. 

; 


Journal of Consult: 7 
EE a a aaa 


Two New Experimental Scales of the MMPI 


Kenneth B. Little* 


Stanford University 


and Jerome Fisher 
VA Hospital, San Francisco, California 


aa investigators (1, 2, 3) have made 
Be ved le or both of two experimental scales 
nee red us in the course of a cluster analy- 
pur e Hysteria scale of the MMPI. The 
ae of this note is to describe briefly the 
D opment of these scales and to indicate 
me of their correlates in clinical and experi- 
mental work, 
ne part of the study of differential person- 
Giant patterns in diagnostic center and general 
z ical patients in a Veterans Administration 
aioe it was observed that the Hysteria 
score was the highest point on the 
ee profiles of both groups. In both, the 
th an T score exceeded 70 despite the fact 
nat the general medical patients were hos- 
alied for nonpsychiatric disorders. The ob- 
ervation of an elevated Hy score in general 
Medical patients is, of course, a common one. 
n the assumption that these elevated scores 
ad a different meaning in a nonpsychiatric 
Population than in one with some history of 
Psychologie disorder, we initiated a cluster 
analysis of the matrix of tetrachoric intercor- 
Telations among the 60 Hysteria scale items. 
ae patient population on which the correla- 
ions were derived consisted of 60 diagnostic 
a neuropsychiatric subjects and 90 ran- 
om admissions to the general medical wards. 
: Nine relatively clear-cut clusters were ob- 
ee Five of these clusters had moderate to 
igh positive correlations among themselves 
and zero or slightly negative correlations 


Standards Branch, 


1 
Now with the Training and 
Health, Bethesda, 


N; Pi 
ational Institute of Mental 
aryland. 


with the remaining four. The latter group of 
clusters had, conversely, moderate to high 
positive correlations within itself. The findings 
suggested, of course, that two primary di- 
mensions underlay the cluster structure. The 
group of five clusters (comprising 23 of the 
Hy items) was composed for the most part of 
statements which consist largely of physio- 
logic symptoms to which the subjects “ad- 
mitted.” This group was labeled the Admis- 
sion (4d) scale. 

The second scale was composed of the 19 
items falling into the group of four clusters. 
These items consisted for the most part of 
items scored if the subject denied their va- 
lidity for him. In content, they were state- 
ments about poor interpersonal relations, feel- 
ings of hostility, suspicion, and the like. The 
second cluster was therefore called the Denial 
(Dn) scale. As a final step, biserial correla- 
tions were computed between each of the re- 
maining 18 Hysteria scale items and the Ad 
and Dn scale scores. Items were added to the 
scale with which they had the highest correla- 
tion. Two items correlated zero with both 


scales and were discarded. 


The item composition of the two scales (as they 
are numbered in the group form booklet of the 
MMPI) is as follows: Ad (32 items)—Items 2, 3, 7, 
8, 9, 55, 103, 107, 128, 137, 153, 160, 163, 174, 175, 
188, 190, 192, 230, 243 scored if marked False, and 
items 10, 23, 32, 43, 44, 47, 76, 114, 179, 186, 189, 
and 238 scored if marked True. Dn (26 items)— 
Items 6, 12, 26, 30, 71, 89, 93, 109, 124, 129, 136, 
141, 147, 162, 170, 172, 180, 201, 213, 234, 265, 267, 
279, 289, 292 scored if marked False, and item 253 
scored if marked True. All 58 items are scored in the 
same direction as they are scored on the Hy scale. 
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Correlations between the new scales and 
other MMPI scales for two different groups 
of subjects,? V = 100 in each group, are given 
in Table 1. The Kuder-Richardson reliability 
coefficients based on all 200 cases were Ad — 
.83 and Dn = .75. Ad has its highest correla- 
tion with the MMPI Hs scale, a not too sur- 
prising observation in view of the 18-item 
overlap between the two scales. In most popu- 
lations, Hs and Ad could be substituted one 
for the other. The Dr scale has as its highest 
correlation that with the MMPI K scale, with 
which it shares nine items in common, 

In the clinical application of these scales, 
it has been found that high scores on the Dn 
scale generally describe the uninsightful, the 
anti-intraceptive, the morally virtuous indi- 
vidual; high scores on Dn are also seen with 
“muted” or pseudo-normal Profiles. Extreme 
scores on the Ad 
depict the person 
tress who complains and is anxious about his 
somatic functions 


all elevated MMP 
have moderate to 


? The subjects were tested as part of 
supported by a grant (M-1132) from the 
Institute of Mental Health, 


a project 
National 


Kenneth B. Little and Jerome Fisher 


Table 1 


Correlations of Admission and Denial Scales with 
MMPI Scales for Two Populations 


General medical Patients referred to 


patients psychiatric service 
MMPI 

scale Ad Dn Ad Dn 

iL ~09 35 —10 4l 
F 52 —23 64-54 
K —33 78 -57 88 
Hs 89 29 %9 -4 
D 59 08 7 =u 
Pa 83 27 46 37 
Mf 17 01 17 =i 
Pa 22 17 48 -23 
Pi 57 —60 75 =i 
Sc 53 43 7353—65 
Ma 19 db 5o 82 
Si 4 49 55 62 
Ad = —30 — —56 
Dn —30 = —56 a 


namics in the behavior and history of the in- 
dividual. 
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The Parental Attitudes of Mothers of Schizophrenics’ 


Marvin Zuckerman 


Institute of Psychiatric Research, Indiana University Medical Center, Indianapolis 
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and Irwin Monashkin 


Purdue University 


gaia choanalytic theorists such as Fromm- 
Bina foe, (3), Rosen (6), and Arieti (1) 
Origin ypothesized that schizophrenia has its 
mother in the early relationship between 
of a i child. They imply that the mother 
tive t hizophrenic child has certain destruc- 
she be of attitudes toward children which 
and eh s to the child through her behavior 
rely yerbelizatigng: Unfortunately, we must 
Sreth, retrospective evidence bearing on this 
mothe esis. Tietze (9) interviewed a group of 
ei rs of schizophrenics and characterized 
ing a overanxious, obsessive and domineer- 
with hi no control group was compared 
objecti ese mothers, and one may question the 
alre ivity of an open interview with a mother 
ady identified as the mother of a schizo- 
Phrenic, 
tn need for more objective techniques 
Noo: parental attitudes encouraged other 
he rchers to develop objective instruments. 
item typical parental attitude survey uses 
á itie, Which are stated in the form of gener- 
Sonna and clichés in order to make them 
to st socially acceptable. The parent 1s aske! 
o — whether she mildly or strongly agrees 
Gra isagrees with these items. Freeman and 
on. (2) used the Shoben Parent-Child 
schi ude Survey in comparing 50 mothers of 
izophrenics with 50 control mothers. They 
Tia E authors are grateful to Donald Moore and 


r = ge P 
garet Morgan for their permission IM making 


br facilities of Carter Memorial Hospital available 
anal this research. Harry Brittain assisted in the 
ysis of the data. 


found the mothers of schizophrenics scored 
significantly higher on the Possessive and Ig- 
noring scales (on the latter scale they ac- 
cepted the .10 level of confidence) than the 
control mothers. Unfortunately, they did not 
control educational or socioeconomic differ- 
ences between their groups. From the way in 
which the control group data was gathered, 
it is likely that differences existed in the edu- 
cational levels of the groups. Furthermore, 
since they relied on volunteer mothers so- 
licited by volunteer students, various selec- 
tive factors could have determined the scores 
in the control group. 

Mark (4), in a more carefully controlled 
study, found that a significant number of 
attitude items distinguished a group of 100 
mothers of schizophrenics from 100 control 
mothers. However, McFarland (5) attempted 
to replicate this study with the same items 
and failed to find a significant number of 
items distinguishing the two groups. 

The purpose of the present study was to 
retest the hypothesis that mothers of schizo- 
phrenics have more severe (controlling and 
rejecting) parental attitudes than mothers of 
normals. 


Procedure 


The Parental Attitude Research Instrument 
(PARI) was the main instrument used in this 
study. This test was developed by Schaefer 
and Bell (7), with items modeled after the 
types used by Mark (4) and Shoben (8). 
An attempt was made to develop a number of 
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short, but internally consistent, scales meas- 
uring specific types of attitudes, to permit 
somewhat broader interpretations than can be 
made from post hoc item analyses. The test 
consists of 23 scales, each of which measures 
some attitude theoretically relevant to per- 
sonality development in, children. Normative 
data are furnished by Schaefer and Bell 7); 
and in a previous article by Zuckerman, Rib- 
back, Monashkin, and Norton (11). A factor 
analysis of the scales using a heterogeneous 
sample, including the group reported in this 
paper, can be found in the latter article. The 
factors found in this study were used to de- 
rive summary scores in the current study by 
weighing scales roughly by their factor load- 
ings. Factor A seems to be an Authoritarian- 
Controlling factor which loads heavily on 16 
of the scales. Factor B seems to be a Hos- 
tility-Rejection factor which loads on three 
scales. Factor C seems to be a Democratic 
Attitude factor which loads on three scales, 


Subjects 


Forty-seven mothe 
patients diagnosed 
acute treatmen 
RI. Ratings 


j N S of the pa- 
tients. Ratings were global, but factors Rig 


sidered included severity of symptoms, chro- 
nicity of the disorder, response to treat 


A i ment, 
and premorbid adjustment. Two of the au- 
thors made the ratings independently, and 


Table 1 


Relation Between Case History Rating and 
Psychiatric Diagnosis 


Case history rating 


pe ee a 

Psychiatric diagnosis 1-3 35-45 5-7 
Nonschizophrenic 8 2 1 
Schizophrenic 0 2 17 


Note.—Chi square, corrected (combining cells) = 15.56, 
df =1, p <.001. 
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Table 2 


Composition of Mothers of Schizophrenic and Mothers 
of Normal Groups 


Schizophrenics’ Normals’ 
mothers mothers 
Level of Mean Mean 
education N age N age 
Grammar school 1i 524 il 520 
High school 24 48.0 24 ai 
College 7 50.7 7 a 
All cases 42 49.6 42 49. 


their ratings correlated .80. The agreement 
between the raters and the diagnosis assign® 

the patient is summarized in Table 1. It ca 
be seen that there is high agreement betwee 
Psychiatric diagnosis and the ratings exceP 
in the middle of the scale where the bordet- 
line cases would be expected to fall. Althous 

there is probably some contamination betwee? 
the two sets of data, the experimenters if 

justified in using the psychiatric diagnosis a 
schizophrenia as a criterion, recognizing hes 
wide behavioral differences may exist with . 
the disorder diagnosed as ‘schizophrenia.’ 

A group of 47 mothers of normals was on 
rived from the older age range of the norma 
sample (11) and from some additional nor- 
mals gathered at a later date, The contr 
group consisted of mothers given the PAR 
at church social and nursery school meetings, - 
with some mothers of students from a nig! 
extension college, 

__ Since education of the mother seems 1 
influence most of the scales and one of the 
factors (11), it was put into the analysis ¢ 
ign using thr : gramm: 

school, high school, aaa sre la differ- 
ences were then compared between diagnostio 
Broups across levels. At the grammar schoo. 
level, there was a Significant age difference: 
therefore, the five oldest mothers of schizo- 
Phrenics and the five youngest mothers of 
normals were discarded. The resultant sam- 
piss, Containing 42 mothers ix eich Erotel 
ate described in Table 2. Sex of the patient 
Was considered before grouping mothers 0 
male and female schizophrenics together- 
Twenty-one mothers of male schizophrenics 


Parental Attitudes of Mothers of Schizophrenics 


were compared with 21 mothers of female 
schizophrenics. A significant difference was 
found on only one scale. Therefore, the 
groups were combined. Other variables con- 
sidered were the child’s diagnostic subclassifi- 
Cation, paranoid vs. other schizophrenics, and 
the time interval between the admission of the 
patient and the administration of the test to 
the mother. Neither of these variables seemed 
to markedly influence the average parental 
attitude scores. 


Results and Discussion 


F The results of the analyses of variance on 
‘actors A, B, and C, and on 20 of the indi- 
vidual scales are reported in Table 3. Only 
One of the differences between groups was sig- 
nificant. The mothers of schizophrenics scored 
weed lower on Scale 8, strictness, than 

e controls. However, 1 out of 23 compari- 
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sons may be considered a finding attributable 
to chance. The differences between education 
levels were significant for Factor A and 14 of 
the 20 individual scales. The ‘interaction ef- 
fects were significant for Factor A and eight 
of the individual scales. An analysis of the 
interaction effect in Factor A can be seen in 
Table 4. At the grammar school level, the 
mothers of schizophrenics tend to score higher 
than the controls, and at the high school level 
they scored significantly lower than the con- 
trols. No differences were found at the college 
level. The results on the individual scales tend 
to follow the same pattern. If we had included 
the 10 subjects discarded to make age equiva- 
lent at the grammar school level, the interac- 
tion effect would have been even more pro- 
nounced. 

The interaction effects are difficult to inter- 
pret. They may indicate that the way the 


Table 3 


Analysis of Variance Results in 


Comparisons of Mothers of Schizophre 


nics and Mothers of Normals* 


Mother’s 


Child’s 
education 


diagnosis Interaction 
s 


Score or scale 


Summary Scores 


A—Authoritarian-Control 
B—Hostility-Rejection 
C—Democratic Attitudes 


Scales 


2—Fostering Dependency 
3—Seclusion of the Mother 

4—Breaking the Will 

5—Martyrdom 

6—Fear of Harming the Baby 

7—Marital Conflict 

8—Strictness 

9—Irritability 
10—Excluding Outside Influences 
11—Deification ‘ 
12—Suppression of Aggression 
13—Rejection of Homemaking Role 
15—Approval of Activity | 
16—Avoidance of Communication 
17—Inconsiderateness of Husband 
18—Suppression of Sex 
19—Ascendance of the Mother 
20—Intrusiveness 
22—Acceleration of Development 
23—Dependency of the Mother 


* a ratios of less than one are indicated by dashes. 
s Significant at or below the .05 level- 
ignificant at or below the .01 level. 


= 15.41** 5.97** 
— 1.89 = 
1.39 = aa 
— 5.80** 111 
— 8.80** 1.80 
13.07** 3.98* 
at 13.21" 1.20 
— 2.76 7.90** 
— 3.99* 1.33 
6.31* 2.80 2.85 
= 1.44 Š ie 
23 10.51** i 
$02 11.07** 4.57* 
= 4,24* 2.02 
1.68 Ce = 
1.35 3.82 2.07 
1.71 10.30** 1.01 
= 15s 4.62* 
— 11.13** onl" 
= 9.78** 2.69 
— 4.10* 4,31* 
— 3.53* 3.62* 
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Table 4 


izophrenics 
i of Means of Mothers of Schizop! 
Compar ad Mothèrs of Normals by Levels on 
Summary Score A 


E Schizo- 3 
lof phrenics’ Normals’ 

Pics mothers mothers t p 
Grammar school 242.09 214.91 1.88 sak 
High school 191.58 219.50 2.86 E 
College 172.86 155.86 94 3-4 


mothers of schizophrenics respond to the test 
depends on their familiarity with the cultural 
expectations for parental attitudes, which, in 
turn, may depend on their education. The 
samples at each level are not adequate to 
justify a conclusion. There is, however, a 
greater relationship between education and 
parental attitudes in mothers of schizophrenics 
than in the controls. The correlation between 
Factor A and education in the original 47 
mothers of schizophrenics was — .632. In the 
original 47 controls it was only — .287. The 
difference between these two correlations was 
significant beyond the .05 level. 
The hypothesis of a difference between pa- 
rental attitudes of mothers of schizophren- 
ics and other mothers was not confirmed. It 
would be difficult to disprove this hypothesis, 
since the Possibility always remains that other 
instruments or techniques may reveal a dif- 
ference. Toms (10) compared 30 mothers of 
male schizophrenics and 30 control mothers, 
using a variety of instruments including an 
interview, vocabulary test, the MMPI, and a 
short TAT. Unfortunately, there was a dif- 
ference in education between the two groups 
which was not taken into account in the 
analyses. However, the general conclusion 
was that the hypotheses of personality dif- 
ferences between mothers of schizophrenics 
and other mothers were not confirmed from 
any of the techniques. One interesting result, 
which bears on our speculations about our 
interaction effects, was that the mothers of 
schizophrenics scored significantly higher on 
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the two MMPI scales measuring defensive- 
ness (L and K). These findings suggest that 
further research on the “schizophrenogenic 
mother” hypothesis might do better using 
tests which control for social desirability and 
response suppression. 


Summary 


It was hypothesized that mothers of schizo- 
phrenics have more severe (controlling and 
rejecting) parental attitudes than mothers of 
normals. Forty-two mothers of schizophrenic 
patients and 42 control mothers were com- 
pared on the Parental Attitude Research In- 
strument. The hypothesis was not supported, 
although significant interactions were found 


between the two groups and levels of educa- 
tion. 


Received July 1, 1957. 
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Representative Elements in Role Construct Technique 


` 


Spiro B. Mitsos. 
Evansville State Hospital 


os to the psychology of personal 
Glveaal as set forth by Kelly (2), each in- 
toed ual has a conceptual system (an organ- 
i set of personal constructs) with which he 
oe x structure to the world around him. Basic 
ated is the constant attempt by each 
aie ual to anticipate events in his sur- 
a 5. Hence, man is thought of in some- 
Soe the same light as the scientist in his 
aa process of prediction and validation. 
fos as the scientist begins with a theory and 
his predictions on the basis of the con- 
life s from that theory, man has a theory of 
Hi Composed of bipolar personal constructs. 
in predictions are made along the lines of 
ese personal constructs. 
ee applying this theoretical framework, 
tects and his associates have developed a 
fea nique designed to elicit the construct 
ni Mework of any given individual. This tech- 
ique is the Role Construct Repertory Test 
(RCRT). 
Pi the RCRT, the subject (S) thinks 
i out certain people he knows—people mean- 
t gful to him and who represent a variety of 
ypes. These people are referred to as “ele- 
ments” and are determined by & role-title list. 
: he S assigns people he knows to fulfill the 
ole titles, Examples are as follows: 


e first blank here. 


1. Write your own name in th 
he same sex as 


8. Your closest present friend of t 


yourself. 
17. The most successful person whom yo 


personally. 


The S is then given these elements three at 
a time and asked to think about the three 
People and decide some important way in 
Which two are alike and which sets them 
ot from the third person. The contrasts are 
isted. Kelly assumes they are important con- 
Structs in the individual’s personal construct 


System, 
Certain other assumptions underlie the 


u know 


RCRT. One of these is the assumption of the 
representativeness of the elements.” “If the 
test is to indicate how the subject develops 
his role in the light of his understanding of 
other people, it is necessary that the other 
people appearing as elements in the test be 
sufficiently representative of all the people 
with whom the subject must relate his self- 
construed role” (2, p. 230). On the basis of 
this assumption, Kelly constructed a list of 
role titles; i.e., self, mother, father, ex-flame, 
pal, authorities, etc. 

This assumption is the focus of concern in 


this paper. Kelly assumes representative ele- 
ments (representative role titles) are neces- 
sary to elicit the most crucial personal con- 
structs. The present research began with the 
simple question: “What would happen if the 


representative elements assumption were vio- 


lated—and why?” 


The problem was further limited to the 


question of consistency of construct labels’ 
with and without the fulfillment of the above 
assumption. Hunt (1) has previously investi- 
gated certain aspects of consistency with the 
RCRT. He examined Ss on two occasions 
with a one-week time interval. Essentially dif- 
ferent role-title lists were used each time. 
However, the two lists were equated as to 
sex, relatives, authority figures, etc. With his 
technique of determining equivalence of con- 
structs, he found the average percentage of 
agreement in constructs used on the two 
protocols to be 69% with a standard devia- 
tion of 6%- 

In Hunt’s research, the assumption of rep- 
ive elements was fulfilled in both 
forms of the test. In the present research, we 
ith the question of whether 
or not similar results will occur if the as- 
lated in one form. The pre- 
dictions were as follows: Construct labels 
elicited by the RCRT will be consistent 
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through time when a representatiye role-title 
list is used. Consistency will also occur when 
the role-title list is nonrepresentative, in this 
case, homogeneous. 


Procedure 


The Ss for this investigation included 20 
psychiatric aides randomly divided into two 
equal groups. One of these groups is referred 
to as the “representative elements group 
(REG)”; the other, the “nonrepresentative 
elements group (NREG).” Constructs were 
elicited from the Ss in the REG in the same 
manner as the Role Construct Repertory Test 
as described by Kelly. (In the present form 
there were 19 role titles and 22 sorts of 3 ele- 
ments each.) All Ss were re-examined with 
the same technique after a three-month in- 
terval. The Ss in the NREG were treated in 
the same manner with a singular exception— 
the role-title list was not used. In its place, 
each S was merely asked to list the names of 

19 personal friends, 

According to the hypothesis, we would ex- 
pect a significant number of constructs elicited 
on the first administration to be repeated on 
the second administration. Such would apply 
to both groups. Each construct for each S on 
the first administration was evaluated indi- 
vidually. If either pole of a given construct 
were repeated verbatim anywhere in the en- 
tire repertory elicited on the second adminis- 
tration, this was considered as repetition. Bi- 
nomial expansion was utilized to establish 5 % 
significance levels for number of constructs 


repeated and number of Ss Tepeating a sig- 
nificant number of constructs, 


Results 


All protocols were evaluated 
both protocols for each S. If 
poles of any given construc’ 
administration were repeate 
the second administration, a replication was 
scored. Thus the potential range of scores 
was 0-22. Applying the binomial expansion, 
16 of 22 replications would be significant at 
the .05 level. 

In the representative elements group, nine 
of the ten Ss repeated significant numbers of 
constructs (P< .02). In the nonrepresenta- 
tive elements group, two Ss did so ($ > .20). 


by comparing 
either or both 
t on the first 
d verbatim on 


Mitsos 


Table 1 


Distribution of Replicated Constructs and 
Significant Subjects 


REG NREG x ? 


Constructs Repeated 170 122 
Constructs Not Repeated 50 76 

02 
Significant Subjects 9 2 636 <0 
Nonsignificant Subjects 1 7 


(One S in the latter group had to be dropped 
because he was not available for re-examina- 
tion.) The results seem to indicate a direct 
relationship between representative role titles, 
on which to base constructs, and consistency 
of construct labels. 

Chi square was computed for the two 
groups comparing the number of Ss repeating 
significant numbers of constructs with the 
number repeating insignificant numbers, These 
data are presented in Table 1. 

Certain questions arose at this point of the 
research. Perhaps the most obvious was the 
Possibility that these results are the result of 
the role-title list yielding the same people on 
each administration, while a different group 
of friends was used each time, Another ques- 
tion is that of whether or not people, when 
responding to such a test, are responding to 
the types of people described on the role-title 
list rather than or in addition to the particu- 
lar people involved? Lastly, are different types 
of constructs elicited when the elements are 
heterogeneous as opposed to homogeneous? 

In an attempt to clarify the results, the Ss 
in the NREG Were re-examined after another 
three-month interval. On this administration, 
Ss used the identical list of 19 friends they 
had produced on the second administration. 
These friends were listed in identical order, 
and the Ss were given identical sorts to elicit 
Constructs. In comparing the second to the 
third administration, three Ss repeated sig- 
nificant numbers of constructs (p > .20)— 


substantially the same results as the previous 
administration, 


Discussion 


It would seem apparent, on the basis of the 
above, that fulfillment of the assumption of 


aX 
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eee of the elements is a 
eee of importance, at least in terms of 
ie am Construct labels were consistent 
filled pee when the assumption was ful- 
the ee inconsistent through time when 

T ption was violated. 
co appear, therefore, that conceptual 
it a ‘ig on the RCRT, at least insofar as 
T ies to the construct labels, must be in 
i way a function of the role-title list and 

e types of constructs elicited thereby. 
ig ems can only be conjectured. The 
thes ikely source of explanation 1s Kelly’s 
i ry itself. The fundamental postulate of 

is system is stated as follows: “A person’s 
oe psychologically channelized by 
way in which he anticipates events” (2, 
he One of the corrolaries of this postulate, 

e “Organization Corrolary,” states: “Each 
Person characteristically evolves, for his con- 
A aa in anticipating events, a construc- 
oe system embracing ordinal relationships 

etween constructs” (2, p. 56). 

According to this corrolary, personal con- 
structs within any individual’s system are ar- 
ranged in a hierarchical structure. “Within a 
construction system there may be many lev- 
els of ordinal relationships, with some con- 
structs subsuming others and those, in turn, 
subsuming still others” (2, P- 57). Subsuming 
constructs are termed superordinal and sub- 
sumed constructs subordinal. 

Relating these corrolaries tO the present 
data, it would seem plausible that, when 
thinking of the people represented on the 
role title list, Ss use personal constructs Ca- 
Pable of describing not only specific indi- 
viduals, but also describing similarities and 
differences between groups OF types of peo- 
ple, i.e., family, authorities, peers, etc. De- 
scription in this case refers to the process of 
labeling dimensions on which one could an- 
ticipate the behavior of these individuals and 
groups. 


_ In the present researc 
tive elements group” described only 2 group 


of friends. These Ss were not concerned with 
describing groups; their sample of people was 
fairly homogeneous. They were concerned, aS 
it were, with only one possible subgroup o 
the heterogeneous group use py the “repre- 
sentative elements group.” The construct of 


h, the «“ponrepresenta- 
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“friend versus nonfriend” might well be one 
of the group of dimensions used with the 
heterogeneous group of people. 

i In other words, it seems plausible that con- 
sistency occurs when the task requires the use 
of generally superordinate constructs. More 
specifically, it might be hypothesized that the 
number of superordinate constructs produced 
in a concept formation situation is a function 
of the heterogeneity of the objects to be con- 
strued. It may well be that each individual 
has an infinite number of subordinate con- 
structs and hence a great deal of leeway in 
construing within the context of a superordi- 
nate construct; in this case, the context of 
friend versus nonfriend. Such an explanation 
would seem to be consistent with Kelly’s fun- 
damental postulate and the “Organization 


Corrolary.” 
Summary 


The purpose of this study was essentially 
that of testing the differential effects of het- 
erogeneity and homogeneity of role titles on 
the Role Construct Repertory Test. Two 
groups of subjects were administered the test. 
One group utilized a heterogeneous role-title 
list, the other a homogeneous group of ele- 
ments. Significant differences were found in 
terms of the consistency of construct labels. 
In the group using the role-title list, a signifi- 
cant (p< 02) number of subjects demon- 
strated consistency of construct labels through 
time. In the group using homogeneous ele- 
ments, only 20 per cent (p > -20) of the 
subjects demonstrated such consistency- 

Tt would appear most likely that such re- 
sults are a function of the heterogeneity of 
the role-title list. When presented with a het- 
erogeneous group of stimulus objects on which 
to perform sorts and attach construct labels, 
individuals tend to produce more superordi- 


nate constructs, whereas more subordinate 


constructs are produced when the construed 


objects are homogeneous. 
Received July 18, 1957. 
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The Taylor A Scale and Clinical Measures of Anxiety” 


Carl G. Lauterbach 
Madigan Army Hospital 


This study was designed to determine the 
relationships of the Taylor A Scale to clinical 
criteria of manifest anxiety, and to compare 
these relationships with those between Welsh’s 
Anxiety Index (AI) and the same clinical cri- 
teria. 

The Ss were 44 male members of the U. S. 
Armed Forces referred to a military hospital 
for psychiatric consultation. 

Three psychologists and a psychiatrist in- 
dependently rated each S on a combined check 
list and rating scale of anxiety. The psychia- 
trist completed his ratings after his initial 
diagnostic interview. Then the psychologists 
simultaneously performed their ratings while 
one of them also administered the Wechsler- 
Bellevue Intelligence Scale to the S. Finally, 
the MMPI was administered, which provided 
both the A scale and AI variables. 

The intercorrelations among the psycholo- 
gists in their anxiety ratings ranged between 
78 and .80. However, none of their ratings 


1 This study is based upon a dissertation submitted 
for the Ph.D. degree, University of Iowa, 1952. The 
writer wishes to express his gratitude to Grant W. 
Dahlstrom, Committee Chairman, and the several 
staff members of the Neuropsychiatric Service, Fitz- 
simmons Army Hospital, who so freely participated 
in obtaining the data. 

2An extended report of this study may be ob- 
tained without charge from Carl G. Lauterbach, 243 
South 80th St., Tacoma, Wash., or for a fee from 
the American Documentation Institute. Order Docu- 
ment No. 5580, remitting $1.25 for microfilm or $1.25 


for photocopies. 


showed a significant relationship to the psy- 
chiatrist’s ratings. Thus, a composite of the 
three psychologists’ ratings was treated as 4 
separate criterion of anxiety from the psy- 
chiatrist’s ratings. An item analysis of the 
check list of anxiety signs resulted in four 
signs being selected, assigned weights, an 
summed for each S to form a third criterion 
of anxiety, referred to as the composite 
weighted check list of the psychologists. 4 
psychiatric diagnosis formed the fourth cri- 
terion of anxiety. 

The A scale correlated .44 (p < .01) with 
the composite rating of the psychologists and 
38 (p < .05) with the composite weighted 
check list. The AI correlated .36 (p < .05) 
with the composite rating of the psychologists. 
Neither the A scale nor the AI correlated sig- 
nificantly with the psychiatric criteria of 
anxiety. 

The two anxiety test measures and the four 
criteria of anxiety were correlated with the 
three validity scales of the MMPI and with 
the F — K dissimulation index. The A scale 
related significantly to the F, K, and F — K 
scales, while there was a lack of significant 
relationships, in general, between the validity 
scales and the criteria of anxiety. In the case 
of the K scale, it appears that K could be 
used as a variable to suppress the error in the 
A scale to improve the latter’s relation to the 
criterion measures. 


Brief Report. 
Received March 15, 1958. 
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Experience of Clinicians, and Speech Characteristics and 
Statements of Clients as Variables 
in Clinical Judgment’ 


Austin E. Grigg’ 


State University of Iowa 


ee he is reading a case history, con- 
a te a psychological test, or interviewing 
fies lent, the clinical psychologist has as a 
cae objective the formulation of certain 
basis, g judgments about his client. On the 
velo a these judgments, the psychologist de- 
ERA his plans for the management of the 
= or for the kinds of recommendations he 
is Loe in a professional report. Very little 
ave nown, however, about the variables that 
operating in making these judgments. 
pice appear to be some empirical findings 
Pe ae that clinical experience, per Se, 
ment not insure more accurate clinical judg- 
10) re a clients, as shown by Luft (9, 
ies ch line (2), and Soskin (11). Some stud- 
ae now that the method by which clinicians 
quire information about the client may not 
in Ve to be the traditional interview procedure 
ag paces for accurate judgments to be made, 
(1) or example, the Borke and Fiske study 
as finding that clinicians were able to make 
ag ate predictions about neurotic pa- 
the s after reading interview statements as 
fen, could make after face-to-face interac- 
ns with these patients, and Luft’s report 
readers of interviews did as well as 
je eners in predicting client responses to ob- 
J€ctive questionnaires. Nor js it clear today 
Just how much information a clinician needs 
about a client in order to make valid judg- 
am paper is based upon a doctoral dissertation 
195 Te at the State University of Iowa, Aia 
Bestions yen acknowledges the ae a a 
rection a Leonard D. Goodstein, oS aS 
Dressed t is study was done. Gratitu rhe Be bane 
Statistic, i Leonard Feldt for his consu 
N al processing of the data. 
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ments, or what kinds of data he needs. Stern, 
Stein, and Bloom (12), for example, found 
that increased observational and test data 
tended to be associated with more accurate 
judgments about individuals, but Gage (3) 
reported a lowering of judgmental accuracy 
with increased observational data and Kost- 
lan (7) found that unless a social history was 
included, increased clinical testing data did 
not make for better predictions. 

In an effort to learn more about the vari- 
ables in an interview situation that may play 
a role in influencing the judgments of clini- 
cians about their clients, three variables were 
manipulated in the present study: the voice 
of the interviewee, the content of the inter- 
view statements, and the training and experi- 
ence of the clinician. 


Procedure 


The first counseling interviews of three 
male clients with personal problems who re- 
ported to a university counseling service were 
tape recorded. During this first visit, the 
clients indicated their appraisal of them- 
selves by making Q sorts with Deck 10 from 
Hilden’s Random Sets of Personal Concepts 
(6), by answering Gough’s Adjective Check 
List (4), and a 25-item Self Report Question- 
naire adapted from the Guilford-Martin In- 
ventory of Factors GAMIN (5). After re- 
peating these measures one week later, each 
of the clients was included in the study since 
the reliabilities of the Q sorts were .80 or 
higher, and the percentage of overlap of items 
on the other two measures exceeded 85 per 
cent. 

From each of the clients’ interviews, a ten- 
minute portion of the tape recording was se- 
Jected on the basis of giving a general state- 
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ment of the client’s complaints without stress 
on specific etiological material, and an exact 
typescript was prepared. Then, an experienced 
actor re-enacted the interview selection with 
the original counselor in whatever manner the 
actor felt the script indicated, but without the 
actor hearing any recordings of the actual 
client. The same male actor was used to re- 
enact each script. 

Thus, for each of the three clients, any one 
of three sets of data could be supplied to a 
given group of clinical judges: (a) the actual 
tape-recorded selection with the client, (b) 
the tape-recorded selection as re-enacted by 
the actor, or (c) an exact typescript of the 
interview selection. Also, since there were se- 
lections from interviews of three clients, it 
was possible to vary the content of the in- 
terviews. 

Twenty-four male clinical psychologists 
with the Ph.D. degree and affiliation with 
the American Psychological Association were 
used as the Ph.D. judges. Twenty-four male 
trainees in clinical psychology constituted the 
Trainee judges and included either graduate 
students with at least one year of practicum 
experience, or clinical trainees in a hospital 
who had completed at least one year of gradu- 
ate work in psychology. A group of Naive 
judges, 24 male undergraduate students from 
the introductory psychology course, were ob- 
tained from Coe College. The Ph.D. and 
Trainee judges were obtained from three Vet- 
erans Administration hospitals: Downey, Illi- 
nois, Iowa City, and Knoxville, Iowa; from 
the Elgin (Illinois) State Hospital, and from 
the Psychopathic Hospital and the Depart- 
ment of Psychology of the State University 
of Iowa. , , 

Groups of judges were given various com- 
binations of the voice and content conditions 
and after each presentation were asked to 
predict (actually, postdict) how the client re- 
sponded to the three personality tests. The 
accuracy of any judge’s predictions was meas- 
ured by the number of agreements between 
these predictions and the responses of the 
clients, called “Client Key.” Later, although 
they were instructed to predict the responses 
of the clients and not the impressions of 

hologists about the clients, the 
other psychologists «Expert 
'udges? predictions were scored by an “Exper 
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Key” made from a consensus of three psy~ 
chologists as to what the clients responses 
“should be”? after these psychologists had 
studied, independently, the complete case 
folder of each client. 

Each of the three experience levels of 
judges was subdivided into three subgroups ; 
of eight judges, and the sequence of pro- 
cedure was so arranged that any one sub- 
group heard a different voice and content 
combination than either of the other two sub- 
groups. Each subgroup, but with different 
voice-content combinations, had the follow- l 
ing three conditions: (a) a client speak his 
own interview content, (6) an actor re-enact 
a different one of the three interviews, and 
(c) an exact typescript of the third and dif- 
ferent interview selection. The order of pres: 
entation was confounded with sequence sub- 
groups, so that each of the above conditions j 
occurred in each possible order of presenta- 
tion as first, second, or last. By using a Lind- 
quist Type IV analysis of variance design (8, 
pp. 285-288), the voice and the content con- 
ditions were “within” effects, and the experi- 
ence levels were “between” effects. 


Results 


Table 1 presents the means and the stand- 
ard deviations of the three variables—experi- 
ence, voice, and content—as measured by the 
Client Key. A summary table of F ratios from 


Table 1 


Means, Standard Deviations of Prediction of Client 
Responses with Variables Manipulated 
in the Study 


Q Sort SR Gough ACL*® 

Mean Sigma Mean Sigma Mean Sigma 
Experience: 
Naive 300 063 14.46 1.51 37.29 18.68 
Trainee .368 063 15.85 1.22 42.89 13.90 
Ph.D. 376 066 16.43 1.17 42.39 20,87 
Voice: 
Client 344 107 16.39 2,22 39.67 16.73 
Actor 333 1124 14.60 2.80 38.81 14.99 
Script 367 108 15.75 2.18 44.10 16.49 
Content: 
#1 -328 112 15.25 2.44 51.72 14.92 
#2 «366 128 14.83 2.93 33.53 12.41 
#3 .350 099 16.65 1.68 37.32 15.23 


^ To reduce 300-item Gough ACL scores to smaller numbers 
190 was subtracted from total agreements between judge a! 
client responses, 
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Table 2 


Summary Table Showing F Values for the Three Measures 


Q Sort Self Report Gough ACL 
Key ` 4 š 
z Client Expert Client Expert Client Expert 
an Effects 
“xperience 5 
Meleni 9.55°* 11.15** 13.76** 3.95* 2. 
ie each (b) 1.02 3.39 115 0.67 goo 3.63" 
cla nt.-Exp. (b) 0.53 261 1.08 0.88 209 0.31 
9 Within Effects j i 
oi 
Content 1.93 12.41** 15.02** 12.47** 5.32% 2.24 
oy aes 2.35 54.62** 16.55** — 22.50** 60.83** 16.93** 
SS nee (w) 1.87 1.71 8.69**  10.12** 9.85% 20.72; 
Gann xperience 0.56 1.74 0.79 0.71 0.38 0.98 
Vani ee 0.26 1.04 0.48 1.84 2.35 2.64 
‘ont.-Exp. (w) 1.68 0.36 1.55 0.04 0.68 0.51 


*§ 
Signi: 
+ Significant beyond .05 level of confidence 
ant beyond 01 level of confidence. 
= saa 
able 2, 
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© doth © the Self Report Questionnaire (SR), 
cantly ous of trained judges were signifi- 
respon more accurate in predicting the clients 
Mor “ine than were the Naive judges (Ż < 
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but no significant voice effects occurred with 
the other content conditions with SR. 

With the Gough Adjective Check List, al- 
though the two trained groups again appear 
to be superior to the Naive judges, statistical 
analysis summarized in Table 2 indicated 
that the differences are not statistically sig- 
nificant. Again, the actor’s voice was associ- 
ated with the poorest predictive accuracy. 
Content 1 was associated with accuracy scores 
strikingly superior to those obtained when 
Content 2 or Content 3 occurred (p < .01). 
Because with Gough ACL a Voice-by-Content 
interaction occurred, an analysis similar to 
that described above with SR data was per- 
zas observed that the client’s 


formed, and it w 
voice was associated with significantly lower 


accuracy scores with Content 3, but this did 
not occur with the other contents. 

With the Client Key, the three measuring 
instruments used—Q sorts, SR, and Gough 
ACL—teacted differently to the variables of 
the experiment (Table 1). With the Q sorts 
and the Gough ACL, the script gave the most 
favorable scores for the voice conditions. With 
each of the three personality measures, the 
actor’s voice lowered the accuracy of the pre- 
dictions. In regard to the content of the in- 
terviews, the three personality measures re- 
acted differently: Content 1 gave strikingly 
superior scores over other contents with the 
Gough ACL, but was the poorest content con- 
dition with Q sorts. Content 2 was associated 
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with the best scores on the Q sorts, but was 
the poorest content condition with the other 
two measures. With SR, Content 3 was associ- 
ated with the highest predictive accuracy. 
Table 3 presents the means and the stand- 
ard deviations of the three variables as scored 
by the Expert Key. The three clinicians who 
composed the key, working independently, 
answered the three personality measures as 
they believed the client “should have re- 
sponded” after they had studied all pertinent 
case history and interview reports as well as 
the actual recorded selections heard by the 
judges in the experiment. The average Q sort 
of the three judges and those SR and Gough 
ACL items on which two or more of the three 
“experts” agreed, constituted the Expert Key. 
As may be seen, the trends in the data are 
similar to those of the Client Key (compare 
Table 1 and Table 3), although now the ac- 
curacy scores are considerably higher. The 
major discrepancy between the results based 
on the two keys occurs in the Q-sort data. 
There, significant voice and content effects 
are revealed with the Expert Key, as shown in 
Table 2. In addition, the “between” compo- 
nent of the Voice-by-Content interaction was 
significant, and the latter effect also occurred 
with the Gough ACL data. Such a “between” 
effect may be associated with the. dispropor- 
tionate number of State University of Iowa 
judges in the three sequence subgroups. Sub- 
group I contained twelve such judges, whereas 
Subgroup II contained seven, and Subgroup 


Table 3 


Means, Standard Deviations with the Variables 
Manipulated in the Study 
(Expert Key) 


Q Sort SR Gough ACL 


Mean Sigma 


Mean Sigma Mean Sigma 


eee S03 .092 16.62 1.65 45.42 18.63 
Trainee .509 .075 1796 1.44 45.54 13.59 
Ph.D. .575—.062 17.57 1.72 45.89 13.78 
Voice: 

i 588 145 18.31 3.17 45.67 18.72 
oie ado iol 1597 399 43.65 18.71 
Script 584313 1788 2.79 47.53 19.87 
ae ee 1769 364 51.57 18.65 
- ‘447 141 15.58 3.35 41.22 18.63 
as ‘608 096 1388 262 44.06 18.74 
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III contained none. While this effect did not 
influence the predictions of how the clients 
responded, it apparently exerted an influence 
when the judges were scored by an Expert 
Key devised by three State University of 
Iowa psychologists. 

Because of the relatively large differences 
between the average scores under the Client 
and Expert keys, it was considered expedient | 
to test the significance of these differences by 
the simple nonparametric sign test (13, pP- 
430-435). The results of this test clearly 
verified the observation that the judges within 
each group show greater agreement with the 
Experts’ predicted responses for the clients. 
than with the responses of the clients them- 
selves. r 


Discussion a 


From the results of this study, it appears 
that judges with one or more years of clini- 
cal experience are able to make more accurate 
predictions about clients’ responses to certain 
personality measures than can be predicted by 
untrained judges. But among judges who have 
had at least one year of training} increased 
experience does not appear to be associated 
with a significant increase in the accuracy of 
predictions. There is the problem of whether 
these results imply that whatever skill is 
added to the individual’s ability to make 
judgments along these lines is acquired rap- 
idly, during the early period of graduate train- 
ing, and that increments thereafter are too 
gradual to make for significant experience 
level differences. The results could be inter- 
preted also to suggest that selection may be 
the important factor here: that certain kinds 
of people, better than average in ability to 
judge the responses of people who are upset, 
enter clinical psychology and that training to 
the level of the Ph.D. does not increase their — 
skills along these lines. Another possibility 35» | 
that perhaps the clients used in this study 
placed the more experienced Ph.D. judges at 
a disadvantage, since they work mostly 1” 
hospital settings, and the clients used in the | 
study were outpatients of a university coun- d 
seling service. — 

In the present study, unlike the Luft studies 
where clinicians were no more accurate than 
nonclinicians, brief interview selections were s 


presented to the judges. It could be that the 
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Sa a the experienced clinician are able 
the = er ae personality appraisals on 
Luit’s he ittle data than are naive judges. 
experienc a on with one-hour interviews that 
than “aie clinicians are no more accurate 
bility a gage judges suggests the possi- 
rial aa oi the amount of interview mate- 
creases h e as a basis for judgment in- 
judges ov e superiority of the experienced 
there m er naive judges may diminish. Or, 
ences be differences due to age differ- 
judges ee in the present study, the Naive 
ations n undergraduates. But these specu- 
While aa await empirical testing. 
ality vee is true that, for all three person- 
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view sele clinical judgment, reading the inter- 
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ore oe The experience groups were 
conditions e than the Naive judges over 4 
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ing used appeared to be an important vari- 
able here. 

5. The script condition, with total absence 
of voice cues, was associated with the most 
accurate predictions with two of the three 
measuring instruments used. 

6. There was no statistically significant in- 
teraction between experience and voice, or be- 
tween experience and content. 

7. The judges, regardless of experience 
level, were in greater agreement with what a 
consensus of “experts” predicted about client 
responses than in predicting the actual re- 
sponses made by the clients themselves. 
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A Note on the Reliability of the Leiter 
International Performance Scale 
1948 Revision‘ 

Heber C. Sharp 


Utah State University 


Since the Leiter International Performance 
Scale (LIPS) was developed, most of the 
reported research has been designed to ex- 
plore the validity of the LIPS by comparing 
it with other measures of intelligence. Reli- 
ability studies seem to have been neglected. 
Leiter (1) states that two types of reliability 
data are available. The type reported most 
frequently compares the standard deviation 
of the LIPS results with those of the accepted 
instrument. Leiter reports a split-half reli- 
ability coefficient of .89 (1, p. 30). Tate (2), 
following Thorndike’s outline (3, pp. 93-95) 
of Holt’s analysis procedure to estimate reli- 
ability, reports a coefficient of .75. The fol- 
lowing data are concerned with a test-retest 
reliability coefficient. 

Procedure. The LIPS was administered to 
48 retarded school children in September or 
October and again in April or May with at 
least a six-month interval between tests. The 
Ss ranged in age from 8 years and no months 
to 16 years and 5 months. 10 Ss were attend- 
ing a special school for seriously retarded chil- 
dren, 21 were attending special classes for re- 
tarded children, and 17 were attending classes 
with other children in the regular schools. 

Results. Statistical data revealed for the 
initial test an M of 65.1, SD 13.67, and the 
range of 38-88. The retest M was 67. 77, SD 
13.73, and the range 41-95. The reliability 

coefficient was found to be .91. A ¢ test to de- 
termine the significance of the difference be- 
tween the means yielded at of 3.15 (p< .01). 


1This study was supported in part through a 


grant from Utah State University research program. 


Discussion. The retest method may intro- 
duce a spurious factor due to carry-over from 
one administration to the other. Ss frequently 
mentioned memory for one or more test items. 
This might account for the difference found 
between the means. Only 6% of the Ss had 
the same score on both test and retest, 27% 
earned lower scores on the retest, and 67% 
showed increases from 1 to 14 IQ points on 
the retest. For this retarded group, some items 
seemed to be improperly placed in the scale. 
Further empirical work concerned with this 
problem is suggested. 

The reliability coefficient of .91 indicates 
both stability and consistency of the LIPS as 
a measuring instrument for Ss at the lower 
end of the intelligence distribution. The simi- 
larity of the variance measures supports fur- 
ther the reliability of the LIPS. Since the Ss 
were drawn from a restricted range of ability, 
thus limiting the spread of scores, the high 
coefficient does not imply necessarily reliabil- 
ity for all types of subjects. 
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The Prediction of Length of Stay in Psychotherapy’ 


Maurice Lorr, Martin M. Katz, and Eli A. Rubinstein 


U. S. Veterans Administration 


and they tend to come from higher socioeco- 
nomic levels than terminators. 

One aim of the present study was to test 
the validity of the predictive test battery on 
a wider range of clinic cases. Another objec- 
tive was to test a series of research hypothe- 
ses concerning the characteristics that differ- 
entiate patients who terminate prematurely 
from patients who remain in treatment. These 
hypotheses grew out of a survey of the litera- 
ture and out of the above mentioned research 
results of the initial study (2, 6, 12). 

The specific hypotheses, in each case from 
the standpoint of remainer characteristics, 


are as follows: 


1. Terminators are more likely to have a 


history of frequent trouble with the law, lack 
of impulse control, hostility to authority, lack 
of goal persistence, and lack of personal ties 
or loyalties. 

2. Terminators are 

3. Terminators are 
anxiety. 

4, Term 


laries. 
5. Terminators are more authoritarian. 


6. Terminators’ socioeconomic level is lower. 


Method 


A nation-wide group of 13 clinics agreed to 
collect data over a period of three months on 
all cases considered for psychotherapy (group 
or individual).? Patients examined for hos- 
pitalization, neurological disorders, or for brief 
(half hour or less) irregular treatment were 


not included. 


less self-dissatisfied. 
less likely to report 


inators have more limited vocabu- 


o the VA Mental Hygiene 
Clinics and respective clinic staffs in the following 
cities for collaborating in the collection of the basic 
data: Baltimore, Brooklyn, Chicago, Cleveland, Den- 
ver, Miami, Newark, Pittsburgh, St. Louis, San An- 
tonio, San Francisco, Seattle, and Washington, D. E 


2We are indebted t 
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The intake interviewer, usually a social 
worker, completed a form at the close of the 
interview describing such patient character- 
istics as his occupation, annual earnings, and 
presenting problems. In addition, the inter- 
viewer estimated how long the patient would 
remain in treatment if accepted. In this way 
the test battery’s success in predicting length 
of stay could be compared with the judgment 
of an interviewer unaided by test information. 
The therapist filled out a data sheet when a 
patient discontinued treatment prior to the 
26th visit for any reason, or at the end of six 
months of treatment if the patient was still in 
treatment at that time. The therapist also in- 
dicated the reason for termination if this oc- 
curred, the frequency and duration of visits, 
and the type of treatment given. 

The measures used, given below, were self- 
administerable and required 45 minutes or 
less for completion. 


1. A 39-item Behavior Disturbance scale taken 
from a longer unpublished inventory devised by 
Applezweig and Dibner. The true-false items include 
elements primarily of a biographical nature designed 
to elicit information concerning the extent of certain 
behavior in the patient’s past. The items ask ques- 
tions concerning lack of personal ties or loyalties, 
lack of impulse control, restlessness, frequent trouble 
with the law, lack of ethical standards, hostility to 
authority, and lack of goal persistence. 

2. A Self-Rating scale consisting of 18 five-point 
graphic rating scales. First the patient rates his 
actual self and then he rates himself the way he 
would like to be on the same scales, The difference 
between the self-rating and the ideal-rating pro- 
vides a measure of self-dissatisfaction. 

3. A 30-item version of the Taylor Manifest Anx- 
iety Scale which purports to measure manifest anx- 
iety (10). 

4. A 15-item multiple choice vocabulary test, which 
represents a modification of the Thorndike selection 
of words in the Stanford-Binet Vocabulary Test. 

5. A 20-item F scale taken from Adorno, Frenkel- 
Brunswik, et al. (1). The scale purports to be a 
measure of authoritarianism and conventionalism as 
defined by the authors. The patient indicates his de- 
gree of agreement with each statement on a four- 


point scale. 


In all, approximately 300 usable cases were 
received from the 13 clinics. Cases were ex- 
cluded from the study if (a) the patient ter- 
minated prior to six full months from the date 
of initiation of treatment with mutual consent 
of the therapist and was rated improved; (b) 
the interval between the initial intake inter- 
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view and the initial treatment was over 10 
weeks; (c) the patient did not receive an av- 
erage of at least one treatment every four 
weeks during his stay in treatment; (d) treat- 
ment was terminated for such reasons as 
transfer, hospitalization, ineligibility, or re- 
location to another city; and (e) the patient 
was female. The first four qualifications made 
the group a more clear-cut sample of termina- 
tors and remainers. The sample was confined 
to male patients because so few female veter- 
ans are seen in VA clinics. 

The criterion used in this study was num- 
ber of weeks in treatment. The number of 
treatments received was considered as a pos- 
sible criterion but rejected since the number 
of treatments scheduled varies from patient to 
patient. Furthermore, the number of treat- 
ments is likely to be a less reliable figure in 
most clinics than sheer length. However, the 
correlation of .60 between the two variables 
indicated that the measures have much in 
common. The entire initial sample of 291 
cases was randomly split into two samples: 
A and B. Patients were so assigned that each 
clinic and each therapist had approximately 
equivalent representation in Subsamples A 
and B. The distribution by weeks of treat- 
ment was also equated in the two samples. 

The criterion distribution was found to be 
U-shaped; only 60 cases were in treatment for 
more than 6 weeks but less than 26 weeks. 
It was also evident, as in the original study, 
that the middle group could not be differ- 
entiated by the test battery from the two end 
groups. Accordingly patients with 6 weeks of 
treatment or less were designated Terminators, 
and patients with 26 weeks or more of treat- 
ment were designated Remainers. The middle 
group of patients staying from 7 to 26 weeks 
was not used in the present analysis. Each 
subsample consisted of 115 cases, with 57 
Terminators and 58 Remainers in each sample. 

To test the research hypotheses, and to 
identify the items in Sample A significantly 
related to the dichotomous criterion, point 
biserial correlations and phi coefficients were 
computed and tested for significance.’ The 
items within a given inventory or test which 
correlated with the Terminator—Remainer cri- 
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terion at the .05 level of significance or better 
ee with unit weights into a sub- 
Bch 3 $ answer sheets were then rescored for 
with T test, and the subtests were correlated 
ae e criterion. The Lubin-Summerfield 
i as procedure (8) was applied to the 
iter lables most highly correlated with the 
of sn This procedure selects from a group 
ables an les the minimum set of effective vari- 
a which will result in the highest possible 
t tiple correlation coefficient with the cri- 

erion, 
the pconfgural approach was next applied to 
by — set of effective variables selected 
appr e square root procedure. The configural 
nee was utilized because it takes into 
any nt the interaction among variables, and 
id eed relationships which are not in- 
Rach in a linear multiple regression equation. 
chot of the four subscores selected was di- 
Omized at the mean and each patient in 
al A was allocated either to the upper 
i el half of each variable. In each case, a 
a r 1 score represented a Remainer score, while 
in W score typified the Terminator. The com- 
ees Upper and Lower categories on the 
Was patlables yields 16 patterns. Each patient 
as classified into one of the 16 patterns. The 
in ‘centage of Terminators and Remainers fall- 
‘8 into each pattern was then determined. 
ealy the percentages were transformed into 
aes of “configural” scores ranging from 0 

9 by the following equation (11): 


% Remainersingiven _ Lowest % Remainers 

Sxso pattern in any pattern 
Highest % Remainers Lowest % Remainers 

inany pattern ` inany pattern 


These configural scores were then correlated 

ith the dichotomous criterion. 

a he beta weights derived from Sample A 
ere then used to score the 115 cases I 
ample B plus an additional 16 cases receive 
ate from one clinic. Similarly, the 16 patterns 
erived from Sample A were used to score the 

Cases in Sample B. Point-biserial correlations 

Were then computed with length of stay to 

determine the degree of cross-validity obtain- 

ng for the four subtests selected. ; 

. To complete the double cross-validation, the 

items for Sample B were independently cor- 

related with the criterion as had been done for 


Sample A. An item was selected for the final 
set if the item-criterion correlation was sig- 
nificant at the .05 level or better in both sam- 
ples (a one-tailed test). 


The Findings 


The first five research hypotheses were 
tested through a comparison of Terminator 
and Remainer scores on the a priori keys for 
the five tests. A result was regarded as sig- 
nificant if the point-biserial correlation was 
significant at the .05 level or better on both 
Samples A and B. None of the a priori keys 
proved to be differentiating in both samples 
although all scores were consistently in the 
predicted direction. 

Differences found between Terminators and 
Remainers in annual earnings, occupational 
level, and highest grade completed were also 
in the predicted direction. However, the differ- 
ences were not at the required significance 
levels in both samples. An examination of the 
data by clinic suggested that there might be 
substantial clinic differences. Consequently, 
data on annual earnings from five of the 
clinics with the largest samples were subjected 
to a two-way analysis of variance. No sig- 
nificant clinic differences and no significant 
interactions between clinics and the criterion 
were found. However, an F test significant at 
the .001 level and a point biserial of .28 indi- 
cated that annual earnings were indeed pre- 
dictive of termination. However, an analysis of 
occupational level and grade level by some- 
what different procedures failed to reveal sig- 
nificant differences between Terminators and 
Remainers for the same five clinics. 

The item analysis of Sample A identified six 
differentiating items in the F scale, eight in 
the Behavior Disturbance scale, eight items in 
the Manifest Anxiety scale, and five items in 
the Self-Rating scale. Each set of items was 
combined into a subscale. The correlations 
among the four subscales, the Vocabulary 
Test, the Social Worker’s Prediction, and the 
criterion were subjected to the square root 
analysis previously described. The criterion 
correlations of the six variables analyzed by 
this procedure are presented in Table 1. A 
multiple correlation of .67 significant at the 
.01 level was obtained between the F subscale 
the Behavior Disturbance subscale, thé Mani- 
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Table 1 


Correlations of Subscales and Social Worker’s 
Prediction with Terminator—Remainer 
Criterion in Samples A and B 


Correlation 


Sample Sample 

Variable A B 
F scale Py ad 07 
Manifest Anxiety scale .30** 25** 
Behavior Disturbance scale 39** .31** 
Self-Rating scale discrepancy 32%* 10 
Vocabulary test 4 .21* 
Social Worker Prediction .36* 36* 


** Significant at .01 level. 

% Significant at .05 level, 
fest Anxiety subscale, the Social Worker’s Pre- 
diction, and the criterion. Application of Sam- 
ple A beta weights to Sample B scores resulted 
in a combined test-score-criterion correlation 
of .39, which is also significant at the .01 level. 

The configural approach to the minimum 
set of four variables yielded a correlation of 
.62 for Sample A. Next, Sample B was scored 
on Sample A patterns. The correlation of Sam- 
ple B patients’ configural scores with the cri- 
terion yielded a correlation coefficient of .43. 
The configural approach thus results in as ef- 
fective a separation of Terminators and Re- 
mainers on cross-validation as multiple regres- 
sion. 

To complete the cross-validation, the indi- 
vidual items significantly correlated with the 
criterion in Sample A were checked on Sample 
B and those significant in Sample B were 
checked on A. By this procedure, 22 items 
proved to be significantly differentiating at the 
.05 level or better (one-tailed test) and in the 
same direction in both samples. The entire 
sample of 230 cases was then rescored on the 
significant 21 items allocated to three sub- 
tests (Anxiety scale, F scale, Behavior Dis- 
turbance scale). Configural scores based on 
these three subtests and the social worker’s 
prediction correlated .50 with the criterion. 

The actuarial items were also correlated 
with the criterion in both Samples A and B. 
Only race and religion proved to be consistent 
in predicting termination of treatment. Negro 
patients were more likely to be terminators 
than other patients (7p,’s of .25 and .18). 
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Jewish patients compared to all others were 
more likely to be remainers (rp’s of .17 and 
-17). Tests were also made for type of psy- 
chiatric disorder, current psychiatric disability 
rating, number of previous courses of treat- 
ment, a listing of ten major problem areas 
(e.g., problems with authority figures, voca- 
tional adjustment, marital conflict), and mari- 
tal status. None were found to relate to the 
criterion at significant levels in both samples. 
Scheduled treatment frequency, length of treat- 
ment interview, type of treatment (group, in- 
dividual, or both) showed no significant rela- 
tion to the criterion. Likewise the analysis 
indicated that the sex, discipline, and length 
of experience of the therapist were unrelated 
to the criterion. 

The possibility remained that a position 
response set was operative in several of the 
original scales and was in part responsible for 
the scale-criterion correlations. The index of 
response set was defined as Rr/Ne —Rr/Nr, 
where Rr is the number of items keyed True 
and marked True by the examinee, and Rp is 
the number of items keyed False and marked 
False by the examinee. Ny and Np are the 
numbers of items keyed True and keyed 
False respectively. Correlations of response-set 
scores with the criterion were computed sepa- 
rately for the Manifest Anxiety and Behavior 
Disturbance scales. The correlations obtained 
were .08 and —.05 respectively. Evidently, 
then, response sets are not responsible for 
these scale-criterion correlations. However, the 
question remained whether the response set 
was acting as a suppressor variable. To check 
this possibility, content and set scores were 
correlated in each scale. Neither coefficient of 
—.14 nor .03 was significant. Thus response 
set as here defined exerted no influence on the 
scale-criterion correlations. 


Discussion 


As we indicated earlier, all of the scores 
based on the a priori keys were in the hy- 
pothesized direction on both samples but not 
at acceptable levels of significance. Of the 89 
items in the Behavior Disturbance scale, the 
F scale, and the Anxiety scale, 22 items were 
significantly correlated with the criterion at 
the .05 level or better in both samples. Only 
one of these significant items was keyed in 4 
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direction not hypothesized. Consequently no 
Other items are inconsistent with the hy- 
Potheses. Do the remaining 21 items tend to 
be consistent with and to support the research 
hypotheses? 

The Behavior Disturbance items will be 
Considered first. The research hypothesis states 
that Terminators are more likely than Re- 
Mainers to report a history of antisocial be- 

‘avior, to lack impulse control, and to lack 
loyalties or personal ties. The following re- 
Sponses seem to support these conjectures: 


Thave been arrested three times or more. (True) 
have never been in a reform school, prison, work- 
Ouse, or jail. (False) 
1 Every man for himself” is the wisest rule to fol- 
ow, (True) 
| T lose interest in things which I cannot get or do 
right away, (True) 
r T have often spent more money than I had by bor- 
Owing on the spur of the moment. (True) 
ight now I have some money saved up. (False) 
telli Sometimes break a date with someone without 
mg him about it. (True) 
When we go out together, I sometimes walk off and 
fave my friends without telling them about it. (True) 


The third hypothesis states that Terminators 
are less likely to report anxiety than Re- 
Mainers. The Taylor scale items correlated 
Significantly with the criterion were the fol- 
owing: 


4 am often sick to my stomach. (False) 
I wen I could be as happy as others. (False) 
find i K AA 
Flee) it hard to keep my mind on a task or job. 
re is often a strain for me. (False) 
™ not very confident of myself. (False) 


(True) hands and feet are usually warm enough. 


Denial of these reactions certainly lends sup- 
Port to the postulated lack of, or failure to 
report, anxiety in the Terminator patient. 
re Terminators more “authoritarian” than 
emainers as hypothesized? Terminators tend 
to agree with the following F scale items which 
are significantly related to the criterion: 
it is best 


When worry, 
a person has a problem or fy Sh 


Or him not to think about it, but to keep 
More cheerful things. 

Owadays when so many different kinds of people 
Move around and mix together so much, a person has 
to protect himself especially carefully against catch- 
Wg an infection or disease from them. 


Sex crimes, such as rape and attacks on children, 
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deserve more than mere imprisonment; such criminals 
ought to be publicly whipped, or worse. 

People can be divided into two distinct classes: 
the weak and the strong. 

There is hardly anything lower than a person who 
does not feel a great love, gratitude, and respect for 
his parents. 

Someday it will probably be shown that astrology 
can explain a lot of things. 

Nowadays more and more people are prying into 
matters that should remain personal and private. 


The statements describe an individual who be- 
lieves in the repression of conflict, who is lack- 
ing in psychological sophistication and insight, 
and who identifies with authority. To the ex- 
tent that these statements represent measures 
of “authoritarianism,” the fifth research hy- 
pothesis is supported. 

We next turn to a consideration of the pat- 
terns established. Let the order of the sub- 
scales be as follows: (a) F scale, (b) Manifest 
Anxiety scale, (c) Behavior Disturbance scale, 
(d) Social Worker Prediction. Let each fre- 
quency distribution be dichotomized at the 
mean. Next let U represent the upper or Re- 
mainer half and L represent the lower or 
Terminator half of each distribution. Then a 
patient allocated to the Terminator pattern 
LLLL is low on all four variables and is char- 
acterized as authoritarian, nonanxious, and as 
reporting an antisocial history; he is also rated 
Terminator by the social worker. An example 
of a Remainer pattern is UULU which repre- 
sents a patient who is nonauthoritarian, anx- 
ious, with a history of antisocial behavior, but 
rated Remainer by the social worker. prs 

An examination of the five most discriminat- 
ing Remainer patterns is revealing. Any com- 
bination of three or more Upper scores is pre- 
dictive of remaining in treatment. The Mani- 
fest Anxiety scale seems to be most crucial as 
judged by the percentage of successes; Re- 
mainers are anxious. The Terminators also are 
best identified by any combination of three or 
more Lower scores. Terminators may also be 
identifed successfully by any three Low scores 
or by any two Low scores providing one is on 
the Anxiety scale. 

The discriminatory validity of the config- 
ural approach may be judged by the data 
presented in Table 2. The optimum cutting 
score for separating Terminators and Re- 
mainers in the cross-validation sample was 
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Table 2 


Number of Terminators (T) and Remainers (R) 
Classified into Each of the 16 Patterns 
(Patients in both Samples A and B are scored 
on Sample A patterns) 


Sample A Sample B 


w 


Pattern 


LLLL 
LLLU 
LLUL 
LLUU 
LULL 
LULU 
LUUL 
LUUU 


PRrROWNUUR RHO 
wwpnoroe] a 


m 


CHOWWAKHKPOKRUNNWNO 8 
oR wwD 


PON RIAWBOROMODAWWA!H 


ma 
RAIN DNHKOR 


first estimated. It is the point of intersection 
of the frequency distributions of configural 
scores for the two criterion categories (4). 
With this cutting score, 56 (or 80%) of the 
Terminators are correctly classified by the test 
battery. This compares favorably to the 55% 
Terminators one would estimate from the base 
rate in the present population. In all, 90 (or 
71%) of Terminators and Remainers are cor- 
rectly classified. 

The Remainer is thus seen as an anxious, 
self-dissatisfied individual with some psycho- 
logical insight who is willing to explore his 
personal problems with others. He has some 
sense of loyalty to others and tends to persist 
in activities he undertakes. He is not likely to 
have been involved in antisocial acts. On the 
other hand, the Terminator either is not anx- 
ious or does not admit to being anxious and 
self-dissatisfied. He is likely to have had a his- 
tory of antisocial acts, he admits to being un- 
dependable and impulsive, and may be au- 
thoritarian or rigid in his social attitudes. 

Agreement of these findings with previously 
reported studies is substantial. Frank et al. 
(3), in their summary, list the following at- 
tributes as related to remaining in therapy: 
social class, education and occupation, fluctu- 
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ating illness with manifest anxiety, readiness 
to communicate distress and personal liabili- 
ties, influenceability, social integrity, and 
perseverance. Similarly, Hiler (5) lists educa- 
tion, intelligence, level of ambition, tendency 
to be introspective, degree of psychological 
sophistication, degree of anxiety experienced, 
and felt dissatisfaction as important variables. 
Other reported studies on the role of social 
class place a greater importance on socio- 
economic status than was evidenced in the 
present study. 

Undoubtedly premature termination is also 
a function of the therapist and the type of 
therapy offered. The therapist-patient rela- 
tion and the competence of the therapist may 
both relate to length of stay in treatment. It 
would also seem probable that in order to 
reduce the rate of dropout, therapeutic pro- 
cedures must be developed for handling the 
relatively uneducated, poorly motivated, and 
psychologically unsophisticated patient. Per- 
haps special orientation procedures are needed. 
Possibly drugs should be used as adjunctive 
treatment. In any case, premature termination 
in large numbers suggests that present clinic 
practice does not meet the needs of a con- 
siderable proportion of patients referred for 
treatment. 


Summary 


The aims of the study were to check the 
validity of a predictive test battery and to 
test six research hypotheses concerning char- 
acteristics that differentiate patients who ter- 
minate prematurely from those who remain 


Table 3 


Number of Terminators (T) and Remainers (R) 
Correctly Classified in Cross-Validation 
Sample B when Cutting Score 
is Optimum 


Actual classification 


Test 
classification d R Total 
T 56 22 78 
R 14 34 48 
Total 70 56 126 
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for six months or longer. Data on five tests 
were collected on 300 cases seen in 13 clinics. 
Scores based on the a priori keys did not dif- 
ferentiate the groups at an acceptable level of 
Significance although all were in the expected 
direction, However, the item analysis resulted 
in three subscales that did tend to support 
four of the hypotheses. The best three sub- 
Scales and the social worker’s prediction com- 
bined configurally correlated .43 with the 

erminator—-Remainer criterion in the cross- 
Validation sample. Compared to Terminators, 
Remainers tend to be more anxious, more self- 
dissatisfied, and more willing to explore per- 
Sonal problems with others. Remainers also 
are less likely to have a history of antisocial 
acts and are more dependable, more con- 
trolled, and more persistent in tasks under- 
taken than Terminators. 


Received November 1, 1957. 
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Suggestibility and Dependency’ 


Marvin Zuckerman and Hanus J. Grosz 
Institute of Psychiatric Research, Indiana University Medical Center, Indianapolis 


In the book Explorations in Personality 
(4), a study relating hypnotizability to per- 
sonality needs is reported. Hypnotizability 
was found to correlate .43 with need for De- 
ference and — .44 with need for Autonomy. 
The Sway Test has been suggested as a pre- 
dictor of hypnotizability (3) and has been 
found to load highly on a factor of “primary 
suggestibility” (2). 

The Sway Test was used as part of two 
other studies going on at this institute. The Ss 
were student nurses. Of the Ss who had taken 
the Sway Test, 27 had also taken the Ed- 
wards Personal Preference Schedule (EPPS) 

(1), a test of manifest needs based on the 
Murray system; and 19 Ss had also taken the 
Thematic Apperception Test (TAT) which 
had been scored by Murray’s need system. 
The authors decided to compare relevant per- 
sonality needs of high and low groups on the 
Sway Test on the assumption that suggesti- 
bility is related to dependency traits. Sway 
tendency was measured in inches of positive 
sway on two trials. The group was divided at 
the median into high and low swayers. 

Although a number of need scores were ex- 
amined in comparing the two groups, three 
are directly relevant because of the White 
study: Deference, Autonomy, and Succorance. 
Succorance and Deference seem to measure 
“Dependency” while Autonomy would define 
the other pole of this dimension. The low 
swayers scored significantly higher on Au- 
tonomy on the EPPS than the high swayers 

1An extended report of this study may be ob- 
tained without charge from Marvin Zuckerman, In- 
stitute of Psychiatric Research, 1100 West Michigan 
Street, Indianapolis 7, Indiana, or for a fee from the 
American Documentation Institute. Order Document 


No, 5581, remitting $1.25 for photocopies and $1.25 
for microfilm. 


(p below .01). The other differences were not 
significant. The Autonomy score on the EPPS 
indicates endorsement of statements which 
express a desire “. . . to be independent of 
others in making decisions, to feel free to 
do what one wants . . . to avoid situations 
where one is expected to conform...” (1, 
p. 5). 

The high swayers scored significantly higher 
on Succorance attributed to the hero in TAT 
stories (p below .05) and higher on Succor- 
ance attributed to all characters in stories ($ 
below .05). The other differences were not 
significant. A need for Succorance on the TAT 
indicates the number of instances where the 
S saw the character in the story asking for or 
receiving help, sympathy, or support from an- 
other individual or when the character is dis- 
turbed over loss of a source of love and sup- 
port. 

The findings from the two personality tests 
are congruent and indicate that a person who 
is suggestible is likely to be a person with 
strong dependency needs, while a person who 
resists suggestion is more liable to have 
stronger needs for independence or autonomy. 


Brief Report. 
Received March 19, 1958. 
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Success and Failure in Client-Centered Therapy 
as a Function of Initial In-Therapy Behavior’ 


William L. Kirtner and Desmond S. Cartwright 


University of Chicago 


In a previous paper (4), the authors re- 
porteg that certain differences in client per- 
onality structure at the outset of therapy ap- 
a to be significantly related to differences 

length and outcome in client-centered ther- 
apy. The present study investigates the hy- 
eed that the manner in which clients ini- 
eed present their problems and their initial 
tio erapy mode of approach to the resolu- 
i iat of those problems are also significantly 
elated to differences in length and outcome. 


Methods and Procedure 
The Instrument 


fi On the basis of the preceding hypothesis, 
ve descriptions of initial in-therapy client 
ehavior were formulated, and each desig- 
hated by one of the letters, V, W, X, Y, or Z. 

Complete statement of each of these de- 
Scriptions follows: 


V: Immediately deals with a feeling-in-relationship 
Problem and has already somewhat localized a rather 
SPecific source or area of difficulty. Deals very much 
en what he says and does, how he acts and feels 
n situations, and discusses the interpersonal effects 
Of these. He is quite internally focused and has a 
very strong and very apparent drive to generate and 
examine impulses, thoughts, ideas, despite resultant 
fear, guilt, sadness, etc. The person orients himself 
MN the therapy situation as if saying: “This is my re- 
SPonse to such-and-such and this is the kind of situa- 
tion in which I find myself; now assuming that I 
Somehow contribute to this situation, I want to alter 
et aa . 
ed upon & dissertation 


1 This investigation is bas lissert 
or to the University of 
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hicago in partial fulfillment of the requirements for 
the degree of doctor of philosophy. It was supported 
in part by research grants from the National Insti- 
tute of Mental Health, National Institutes of Health, 
U. S. Public Health Service, and from the Ford 


Foundation. 


my responses and behaviors and resolve or diminish 
the disturbances I feel.” 

W: Immediately deals with feeling-in-relationship 
problems but has not clearly differentiated a specific 
source of difficulty. That is, relational difficulties are 
perceived, but the feelings involved are not under- 
stood; no clear connection with the situation is ap- 
parent. There is strong drive toward clearer differ- 
entiation and understanding of where the source of 
interpersonal or self-disturbance lies and how it oc- 
curs. There is as well a general concern to discover 
just how and where in his disorders he himself is 
contributing, and effort is spent in driving himself to 
look at generated impulses for his contributions to 
his undesirable life situations so that he might change 
and resolve his disturbances. 

X: Vacillates between dealing with relationship | 
problems and discussing externals and listing attri- 
butes of situations and of others. He may openly 
exhibit emotional behavior: eg. depression, crying, 
fear, anger, etc. He may give way to a mood or feel- 
ing experience of the moment but usually expresses 
or discusses these feelings in terms of external cause 
rather than in terms of “this is my response to such 
and such” (external) ; though, to repeat, there is 
usually a vacillation between expression of mood or 
emotion and discussion of it in terms of internal and 
external causes. In a word, he vacillates between ex- 
pressing himself about basic feeling and interaction 
problems and the manifestations of those problems 
in very general terms without definite pointing to 
his own contributions to situations and his responsi- 
bility in them; and yet shows definite indications 
now and then of feeling that he is in some way a 
contributor and has some responsibility for the 
situations. 

Y: Does not deal with feeling-in-relationship prob- 
lems but discusses external manifestations of internal 
difficulties; or discusses feelings as if they are ex- 
ternal objective things to be intellectually named, 
labeled, or categorized (e.g, “I use a lot of atten- 
tion-getting mechanisms in social situations”). There 
is a rigorous intellectual control of impulses so that 
they are shunted into structured categories and ex- 
planatory generalities which seem to give a measure 
of momentary satisfaction and comfort. Such deal- 
ing, shunting, and applying of generalities appear to 


329 


330 


William L. Kirtner and Desmond S. Cartwright 


Table 1 


Results of Application of the Five Descriptions to First Therapy Interviews of Twenty-four Cases for Which 
Both Length of Therapy and Therapist Success Rating Were Known to One of the Judges 


Failure zone Short failure Short success Long success Long failure 
(13-21 (12 or less (12 or less (More than 21 (More than 21 
Client interviews) interviews) interviews) interviews) interviews) 
1 Z ¥ V wW X 
z x x vV WwW sa 
3 Y Y v X 
4 X Z ie W 
5 Y Z me 
6 X X 
7 Y Zz 
3 sis Z 
9 Z 


represent problem-resolving activity and are usually 
followed by a similar procedure about another be- 
havioral area. There is strong avoidance of discus- 
sion on the feeling level in relationships, but listing 
of attributes of feeling life may be done intellectually 
and analytically. 

Z: Deals with problems as though they are almost 
entirely external to him. The localization of source 
of difficulties is seen to be vaguely “beyond” the 
person, the focus being quite external. His approach 
is almost that of listing attributes of people and 
situations, with very little self-responsibility under- 
stood. It is as if at times the person is attempting to 
resolve his difficulties by explaining the people with 
whom he is involved, disturbed about, guilty toward, 
etc. It is sometimes as if he is saying: “Things should 
be different, and if they were, Id be all right.” He 
often appears to be describing the various facets of 
disturbing situations and relationships as if they are 
entirely outside him and as if then waiting for some- 
thing to be done about them. Since he focuses the 
problems outward, he seems to be asking: “What 
can be done to change this so that I won’t feel dis- 
turbed?” The therapy situation thus seems to be tri- 
polar: the client, the problems, the counselor. There 
is avoidance of discussion of internal feelings in re- 
lationships, even though feeling may be apparent in 
voice tone, gesture, words used, etc. 


Subjects 


The total sample for this study is com- 
posed of 42 cases, all seen by therapists at 
the Counseling Center, The University of 
Chicago, during the period 1949-54. They 
were participants in various research programs 
being carried out at the Counseling Center at 
that time. The sample was composed of 21 
students, 21 nonstudents. There were 20 fe- 
males and 22 males. The mean age was 27.9 


years; the age range was from 19 to 41 years. 
Forty-one of the cases had male therapists; 
in one case the therapist was female. 

Twenty-four cases from the total sample 
Tepresent only the extremes on a therapist 9- 
point success rating scale—that is, ratings of 
1 through 4 being failures, and 7 through 9 
being successes. The remaining 18 cases of the 
total sample represent the more middle range, 
points 5 and 6, of the 9-point rating scale, as 
well as its extremes. 


Procedure 


The instrument described in a previous sec- 
tion of the present paper was applied to the 
first therapy interview only of each of the 
42 cases constituting the sample. Both length 
of therapy and therapist success rating were 
known by the senior author (who acted as 
one of the judges) for 24 of the 42 cases. Of 
these 24 cases, 14 were examined and rated 
jointly by him (Judge I) and another judge 
(II). The remaining 10 of these 24 cases were 
tated independently by the two judges. 

For the remaining 18 cases of the total 
sample, neither judge knew length of therapy 
or therapist success rating for any case.” Ap- 
plication of the descriptions to 14 of these 18 
initial therapy interviews was made independ- 
ently by each judge. Judge I alone applied 
the instrument to the remaining 4 cases. 


2D. S. Cartwright collected the interview material 
and coded it for use by the two judges. 
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Results 


Joint rating of 14 of the 24 cases for which 
the senior author alone knew both length of 
therapy and therapist success rating resulted 
m the two judges reaching immediate con- 
Census. Independent application of the in- 
strument to the remaining 10 of these 24 cases 
resulted in perfect agreement between judges. 

Table 1 presents the results of application 
of the instrument to these 24 cases grouped 
according to length-by-outcome. 

The foregoing applications indicate the 
following predominant relationship between 
Client groups and instrument descriptions: 
(a) the failure-zone group may be mainly 
Characterized as Y, with two exceptions wich 
are Z and X; (b) the short failures may de 
characterized as Z and Y, with one exception 
Which is an X; (c) the short successes may 
all be characterized as V; (d) the long suc- 
cesses may be characterized as W, with one 
rXception which is an X; and (e) the single 
Ong failure is described as X. 

Since the block of 18 cases represented both 

e middle range and the extremes of the suc- 
©ess-failure scale, it was necessary to redefine 
Prediction points for success and failure with 
espect to these cases. Cartwright (2) had 

€Monstrated the mean success rating for the 
Population of clients terminating therapy at 
the Counseling Center, The University of Chi- 
cago, to be approximately 5.00 on the thera- 
Pist 9-point success rating scale. Thus, for the 
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purposes of classifying these 18 cases, the 
writers chose to define therapeutic success as 
a rating of 6 or more on that scale, and fail- 
ure as a rating of 5 or less. 

Table 2 presents the results obtained from 
the judges’ application of the descriptions to 
the first therapy interviews in the block of 
18 cases, within the framework of the actual 
length-by-outcome groupings. 

Inspection of the data shown in Table 2 
indicates that the two judges agreed on 13 of 
14 ratings with respect to application of de- 
scription to client, a result significant at bet- 
ter than the .005 level of confidence. 

The results also indicate the following pre- 
dominant relationships between descriptions 
and clients: (a) Short failures may be char- 
acterized as Z or Y, with one exception which 
is an X; (b) short successes were not pre- 
dicted, though two are given such actual rat- 
ings by the therapist, being rated by the two 
judges as short failures, Z; (c) long successes 
may be characterized as W or X, with one ex- 
ception which was rated by both judges as a 
short failure, Z. Comparison of these findings 
with those in the previous block of 24 cases 
indicates that, with a few important excep- 
tions, the predominant relationships between 
instrument descriptions and length-by-out- 
come groupings appear to hold. 

Something should be said concerning the 
important exceptions mentioned in the pre- 
ceding paragraph. First, with respect to the 


Table 2 


Par of Interviews in Eighteen Cases, 
ay te e Descriptions to First Therapy . 
aa ge eae ae of Their Actual Length-by-Outcome Groupings 


within th 


Short success Long success 


Short failure (12 or less (More than 21 

Ue ee. interviews) interviews) 

interview: SS ee 

E Tole Totem iets 
i = x Z Z WwW Not Rated 
J #2 Gh Z W WwW 
? . Not pue x Not Rated 
4 Y Y x x 
5 À Not Rated x x 
6 Z x z Z 
7 Z A j 
8 Zi Z 
9 Ž Z 
= 
go 
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two cases rated by the therapists as short 
successes and by the judges as short failures, 
perhaps little more can be said than that the 
criteria used by the therapists in these cases 
must have been markedly different from those 
employed by the judges. A reauditing * of the 
initial interview in these two cases results in 
the same conclusion as that given in the first 
place—namely, that within the framework of 
the instrument developed for this study, no 
other prediction than short failure appears 
possible with respect to these two cases. 

It should be remembered in this connection 
that the instrument predicted the length of 
therapy quite adequately in both cases. With 
respect to length of therapy, no cases fell 
within the failure zone (13-21 interviews); 
only two cases fell within the short success 
category, and there were no long failure cases 
in this subsample. In order to demonstrate 
statistically something of the predictive value 
of the instrument with regard to length of 
therapy, the subsample of 18 cases was di- 
chotomized on the length dimension. Since 
Cartwright (2) had also demonstrated that 
approximately 50% of the clients entering 
therapy at the Counseling Center leave ther- 
apy at or before the 15th interview and ap- 
proximately 50% remain in therapy for 16 or 
more interviews, these divisions were chosen 
to form the dichotomy. A two-by-two table 
formed on these two divisions of length shows 
that only one case was incorrectly placed; 
the result is significant at better than the .002 
level of confidence. A comparable table formed 
on the dichotomy of therapeutic success (rat- 
ings of 6 or more on the 9-point scale) and 
failure (ratings of 5 or less on the 9-point 
scale) shows that only three cases were in- 
correctly placed; the result is significant at 
better than the .015 level of confidence (3). 

Of considerable importance is the distribu- 
tion of the X descriptions throughout the 
sample. A number of cases were designated 
as X, and each length-by-outcome group con- 
tains one or several of those so designated. 
Since the instrument did in general differ- 


3 Perhaps it should be stated that an original audit- 
ing and fitting of a description requires approximately 
two and one-half to three hours. Acoustical equip- 
ment now in common use would probably reduce 


the time considerably. 
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entiate correctly the length-by-outcome group 
into which each case should be placed, the 
evidence is clear that the X description is not 
adequately defined for a specific and particu- 
lar task. Such a conclusion derives from the 
observation that cases rated as “long therapy 
X” are almost invariably rated by the thera- 
pist as successful, whereas those rated “short 
therapy X” are almost invariably rated by 
the therapist as failures. The basis for this 
distinction is not clear. Perhaps further in- 
vestigation of these sorts of matters will lead 
to descriptive behavioral differences on the 
basis of which clearer and more reliable pre- 
dictions can be made. No further resolution 
of rating discrepancies apparent in this study 
can be made at the present time. 


Discussion 


Following examination of factors such as 
age, sex, status (student-nonstudent), and 
therapist, in relation to length and outcome 
of therapy, Cartwright concluded that (1, P 
362) “. . . certain individual differences þe- 
tween clients . . . give rise to different kinds 
of therapeutic process.” In addition, he hy- 
pothesized that the failure-zone may be char- 
acterized by (1, p. 363) “a drastic behavioral 
manifestation of resistance,” suggesting that 
“If such a view were confirmed by further re- 
search, it would raise seriously the question 
of whether or not client-centered therapists 
should modify their approach to therapy to 
include the Possibility of temporarily directive 
behavior at a point during this critical failure 
zone when it seems likely that a client will 
leave.” 

The present study supports Cartwright’s 
hypothesis that individual differences between 
clients account, at least in part, for different 
kinds of therapeutic Process, However, as 4 
result of the present study, it would seem 
that earlier rather than later in-therapy modi- 
fication of therapist approach might be de- 
sirable or required if failure-zone as well aS 
short failure cases are to remain in therapy- 
Whether or not such modification of therapist 
approach should be toward “directive” opera- 
tions remains unclarified. 

In contrast to the earlier hypothesis con- 
cerning resistance during the critical failure- 


we 
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zone period, the present study suggests that 
the resistance may be identifiable at the out- 
Set of therapy, though such a suggestion does 
not rule out the possibility of increasing re- 
Sistance and drastic display of it in later pe- 
tiods of therapy. 

It seems reasonable to suppose that the 

manner in which the client conceptualizes and 
attempts to resolve his problems will have 
much to do with whether or not he achieves 
resolution. In client-centered therapy as prac- 
ticed today, there is no place for activity on 
the part of the therapist specifically directed 
toward helping the client to change an ineffec- 
tive mode of approach to the resolution of his 
Problems. Persistent understanding and ac- 
Ceptance of a “resistant” mode of approach 
may well do little more than reinforce that 
approach, 
_ Whether modes of approach to problems are 
indeed modifiable at all is, of course, an open 
question waiting upon controlled investiga- 
tion. But the writers conclude that in subse- 
quent study of the therapeutic process, spe- 
cial attention must be paid to that aspect 
of interaction between client and therapist; 
namely, to the client’s approach to his prob- 
lems and the therapist’s responses to that 
approach, 


Summary 


The first therapy interviews of 42 clients 
seen by client-centered therapists were ex- 
amined through the application of an instru- 
ment describing five differing modes of client 
initial approach to the resolution of personal- 
life difficulties. 

Results from two independent judges showed 
that the descriptions differentiated rather 
clearly the length-by-outcome groups consti- 
tuting the total sample of the study. A discus- 
sion of these results followed, and it was con- 
cluded that the manner in which clients ap- 
proach and conceptualize their problems will 
have much to do with whether or not resolu- 
tion is achieved. 


Received July 31, 1957. 
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Some Psychological Correlates of Field Independence’ 


David Marlowe 


Ohio State University 


Recent research has dealt with the relation- 
ship between personality factors and field in- 
dependence. Witkin et al. have reported that 
“the personality characteristic most closely 
related to field dependence or independence 
seems to be the tendency toward active coping 
with or passive submission to the environ- 
ment” (2, p. 474). Field independent persons 
were described as more analytical and more 
capable of mastering environmental forces 
than field dependent persons who were charac- 
terized as passive and submissive toward au- 
thority. Wertheim and Mednick (1) reported 
a significant relationship between field inde- 
pendence and need achievement. The present 
study attempted to test the above findings 
using objective paper-and-pencil tests. It was 
hypothesized that field independence is posi- 
tively correlated with needs Achievement, 
Autonomy, Dominance, and Intraception and 
negatively correlated with Succorance. 

Sixty-nine undergraduate Ss (57 female, 12 
male) were administered the Edwards Per- 
sonal Preference Schedule (EPPS) and the 
Thurstone adaption of the Gottschaldt Em- 
bedded Figures Test (EFT). On the EFT, S 
was shown 18 simple geometric designs, each 
followed by four complex designs with in- 
structions to find the simple design in the 
complex designs. S’s score on the EFT was the 
number correct in the 20 minutes alloted for 
the task. 

Product-moment correlations were obtained 


1 An extended report of this study may be obtained 
without charge from David Marlowe, Ohio State 
University, Room 304, Arps Hall, Columbus 10, Ohio, 
or for a fee from the American Documentation In- 
stitute. Order Document No. 5692, remitting $1.25 
for microfilm or $1.25 for photocopies. 


between scores on the EFT and the scores on 
each of the 15 needs measured by the EPPS. 
Ss’ scores on the EFT ranged from 9 to 34 
with a mean of 21.3. The greater the S’s score 
on the EFT, the greater the field independence. 

Of the five needs hypothesized to be rele- 
vant, only two yielded significant correlations 
with field independence: Intraception, 34 (? 
<-01) and Succorance, —.30 (p < .02). It 
can be concluded that in the present sample, 
field independence is associated with the need 
to be analytical in regard to the behavior and 
motives of one’s self and others (Intracep- 
tion), and with a relative absence of passive- 
dependent needs (Succorance). These results 
offer only partial support for Witkin’s find- 
ings. Most noteworthy is the failure of Au- 
tonomy and Dominance to yield significant 
correlations. These needs may be considered 
similar to Witkin’s “active coping” and “mas- 
tery of environmental forces” factors. The 
failure to obtain results similar to Wertheim 
and Mednick’s for need Achievement may be 
due to differences between the studies in meas- 
uring instruments. In particular, n Ach as 
measured by fantasy materials may not be 


equivalent to n Ach as measured by the 
EPPS. 


Brief Report. 3 
Received April 28, 1958. 
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Psychoanalysts as Expert Observers of 
the Therapy Process’ 


Richard L. Cutler, Edward S. Bordin, Joan Williams, 
and David Rigler ° 
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Our research group has as its major interest 
Mis study of the process of psychotherapy, 
at is, the analysis of the interaction between 
Patient and therapist (2, 3, 6). One im- 
mediate goal is the testing of several specific 
Ypotheses concerning the relationship of the 
€rapist’s interpretive activity to the mani- 
€station of resistance in the patient. Due to 
€ relative recency with which interest in this 
area of therapy research has developed, how- 
€ver, we have found it necessary to digress in 


„Order to solve some of the measurement and 


Methodological problems involved in opera- 

Honalizing our variables (1, 5). This paper 

reports a further research concerned with the 

effects of varying conditions of rating and 

Classes of raters upon one of our key variables, 
€pth of Interpretation. 

Ina previous study clinical psychologists 
Made ratings of therapy interviews on Depth 
of Interpretation under varying conditions of 
Presentation, context, and unit size. In that 
Study, as in the present one, interpretation was 

efined as “any behavior on the part of the 
€tapist that is an expression of his view of 
€ patient’s emotions and motivations . . .” 
4, P. 247). The greater the disparity between 
he view expressed by the therapist, and the 
Patient’s awareness of these emotions and 
Motivations, the deeper the interpretation. A 
Seven-point scale for rating Depth of Inter- 
Pretation was developed by the Method of 


* This study was carried out under the auspices of 
United States Public Health Service Grant M-S16, 
Analyses of Therapeutic Interaction,” E. S. Bordin 
and R, L, Cutler, Principal Investigators. 

? Now at Children’s Hospital, Philadelphia, Penn- 
Sylvania. a 


Equal Appearing Intervals from 70 statements 
descriptive of therapist behavior. An analysis 
of variance revealed: (a) Raters were able to 
apply this particular scale so as to distinguish 
between interviews; (b) a single, over-all rat- 
ing of an interview led to a deeper rating than 
that obtained.from the mean of response-by- 
response ratings; (c) ratings made from type- 
scripts did not differ from those based upon 
tape recordings. 

All of these findings supported our expecta- 
tions. Contrary to what we anticipated, how- 
ever, there were no differences ascribable to 
varying amounts of context. That is, it made 
no difference whether the raters were given the 
immediately preceding interview in its entirety 
before rating the crucial interview, or whether 
they made their ratings using only the thera- 
pist’s responses, with all patient material de- 
leted. 

It was primarily because we were concerned 
about this inability of our raters to utilize in- 
creasing amounts of contextual information to 
increase their interjudge agreement that the 
present study was designed. We first sought 
logically to identify those elements in the 
stimulus material which were potential con- 
tributors to the variance in rating Depth of 
Interpretation. The first of these hypothetical 
contributors, Element A, may be thought of as 
consisting of valid cues from the stimulus ma- 
terial which provide evidence as to the level of 
the Patient's awareness of his emotions and 
motivations, as to the therapist’s expression of 
his view of the patient’s emotions and motiva- 
E oe as to the disparity between 

ih , Element A represents the “true”? 
variance of Depth of Interpretation. The 


335 


336 


second, Element B, consists of a set of cues 
which lead to reliable judgments based upon 
some implicit, absolute conception of what 
constitutes a deep or shallow interpretation. 
The third, Element C, consists of irrelevant 
or interfering cues from either the patient’s or 
the therapist’s comments, which serve to mis- 
lead or confuse the raters. A fourth element, 
which is relatively independent of the stimu- 
lus material, but which interacts with Ele- 
ments A, B, and C in the total rating process, 
is the sensitivity to the various proportions of 
A, B, and C in the stimulus material which is 
available in the particular judge population. 
It is immediately apparent that Element A 
should be present to a greater degree in a 
situation where stimulus material is presented 
with more, rather than less, context. Element 
B may or may not be increased by increasing 
the amount of contextual material available to 
the judges during the rating process. Element 
C is almost certainly increased, since the 
judges are asked to maintain an awareness of 
considerable additional material, and must, in 
addition, decide whether a given bit of stimu- 
lus material is valid and relevant (Element 
A) or irrelevant (Element C). 
We were thus led to consider the possibility 


Table 1 
Assignment of Raters to Experimental Conditions® 


Typescript (TY) Recording (RE) 


Therapist Preceding Therapist Preceding 
Only Interview Only Interview 
(TO) (PI) (TO) (PI) 

bA,I, 4,1 A,I, 2,2 A,1,3,4  Á,I,1,3 
A,II,4,1 A, 1,2,2 A,1I,3,4 A, II, 1,3 
A, I, 2,4 A,U,4,3 A,II,1,1 A,II,3,2 
F,IV,2,4 F,1V,4,3  F,IV,1;1 F,IVv,3,2 
F,V,3,3 F,V,1,4 F,V,4,2 F,V,2,1 
F,VI,3,3 F,VU1,4 F,VI,4,2 F,VI,2,1 
A, VIL, 1,2 A,VIL,3,1 A, VII,2,3 A, VII,4,4 
F, VIII, 1,2 F, VII,3,1 F, VIII, 2,3 F, VII, 4,4 


Note.—The latin square was originally designed to pair one 
analyst and one fledgling in each of the four order-condition- 
case sequences. However, due to difficulties in obtaining quali- 
fied raters, it was necessary to modify the design as above, 

a This table may be recomposed into a modified latin-square 
design. 

b Key to notation, Capital letters refer to Analyst (A) or 
Fledgling (F). Roman numerals indicate judges’ identifying 
numbers. First arabic numeral in sequence indicates interview 
number. Second arabic numeral in sequence indicates order in 
which the particular judge performed this segment of his 
rating task, 
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that the judge population was crucial in this 
particular rating process, and that a particular 
kind of sensitivity to the nuances of thera- 
peutic interaction was necessary to enable 
judges to capitalize upon the additional con- 
textual material to increase their interjudge 
reliability. Given adequate training in the per- 
ception of cues in the patient’s and therapist’s 
responses relevant to the rating of Depth of 
Interpretation, and in the disregarding of ir- 
relevant or confusing cues, our judges should 
demonstrate more convincing interjudge agree- 
ment than had been found in the earlier study- 


Procedures 


Accordingly, we enlisted as expert judges in 
this study four psychoanalysts and four psy- 
chiatrists who had completed their personal 
analyses and were undergoing control training 
in psychoanalysis, but who had not yet been 
admitted to full standing in either the local of 
national analytic societies. The former group 
are hereafter called analysts; the latter, for 
want of a better term, fledglings. 

i Our rationale for the selection of this par- 
ticular judge population was as follows: even 
though our clinical psychologist judges had 
had experience as psychotherapists, only a few 
had completed a personal analysis, and none 
had had the benefit of psychoanalytic training. 
We felt that the emphasis in analytic training 
upon the development of an acute self-aware- 
ness, with its consequent increased perceptual 
and interpersonal sensitivity and objectivity, 
might better enable the analysts to judge the 
degree of the patient’s awareness of his emo- 
tions and motivations, to assess the therapist’s 
statements concerning his view of the patient’s 
emotions and motivations, and hence more 
reliably to rate Depth of Interpretation. These 
judges should also be better equipped to weed 
out irrelevant cues, and perhaps to be less led 
astray by invalid cues of Element B. In short, 
we hoped that the analysts and fledglings 
would be better able to capitalize upon in- 
creased amounts of contextual information tO 
increase their interjudge agreement by making 
maximal use of Element A and by limiting the 
distracting effects of Element C: 

In addition, by including the fledglings, W? 
hope to assess the effects of varying amounts 
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Table 2 
Breakdown of Sums of Squares and F Tests for Analysis of Variance 
Sum of Mean 
Source of variation squares df square F 
Sequences 4.26 3 1.420 33.02** 
aters within sequences 5.46 4 1.365 31.74** 
Total between raters 9.72 7 
Order 05 3 .017 —- 
Interviews 1.93 3 .643 14.95** 
Experimental conditions 28 3 093 2.16 
Presentation 08 1 .080 1.86 
Context 01 1 -010 EE 
Presentation X Context 19 1 .190 4.42 
Pooled error .65 15 043 
Total within raters 2.91 24 
Grand total 12.63 31 


ai 
* Significant at the 01 level. 


of training and experience within the group 
Which had had the benefit of formal analytic 
training. 

_ A modified latin-square design was pro- 
jected which was essentially a replication of 
the design of our earlier study. It permitted 
the systematic variation or control of two 
levels of context (therapist responses only vs. 
Preceding interview) and two methods of 
Presentation (typescript vs. tape recording). 
It also enabled us to assess the effects of prac- 
tice, order of presentation of the interviews, 
judges, and differences due to the interviews 
themselves, In addition, it was possible to ob- 
tain a rough estimate of the effect of experi- 
ence within this judge population (analysts vs. 
fledglings) by means of a é test, although this 
difference is confounded with order and condi- 
tions, In the actual process of rating, each 
Judge rated each of the four interviews Te- 
Sponse-by-response on the seven-point Depth 
of Interpretation rating scale (Table 1). 


Results 


The results of the analysis of variance are 
presented in Table 2. A word should be said 
at this point about this analysis. We were 
concerned with the effect of the varying condi- 
tions of rating upon the means of the response- 
by-response ratings in an interview. These 


means are extremely stable, and thus the total 
sum of squares is extremely small. In order to 
be conservative, we included the second and 
third order interactions in the error term. 

The analysis of variance showed that, as in 
the previous study, this second judge popula- 
tion was able to apply the Depth of Interpre- 
tation rating scale to differentiate between 
interviews. By far the greatest amount of the 
total variance was contributed by the judges; 
neither order of presentation nor varying 
amounts of context contributed significantly to 
the variance. However, the context by presen- 
tation interaction approached the .05 level of 
significance. 

A second portion of our data analysis was 
directed toward the interjudge agreement or 
rating reliability across and within the varying 
conditions. A summary of the interjudge re- 
liabilities by cases is presented in Table 3, 
The product-moment correlations are remark- 
ably constant across Cases I, II, and III, but 
in Case IV there is a significant drop in inter- 
judge reliability.* A possible explanation for 
this difference lies in the fact that while Cases 


$ Significance of difference between ranges of cor- 
relations was assessed in every case by the Median 
test, a nonparametric statistic which does not require 


the assumption of underlyin, ity i 
> g normality in the 3 
lation of correlations (7). á oe 
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I, II, and III are counseling or psychotherapy 
sessions with normal or neurotic subjects, 
Case IV is from a series of interviews between 
a schizophrenic patient under insulin treat- 
ment and an inexperienced psychotherapist. 

In Table 4 are presented the interjudge re- 
liability coefficients by conditions of presenta- 
tion and context. Significantly higher inter- 
judge agreement is found when the analyst- 
fledgling judges rate under identical conditions 
of presentation and context than when ratings 
are made under totally different conditions. 
However, the rather startling result is re- 
vealed that when this group of judges had ad- 
ditional contextual material at its disposal, 
the interjudge reliabilities were significantly 
lower than when they made their ratings on 
the basis of information from the therapist’s 
responses alone. When the results for the 
analysts and fledglings are viewed separately, 
the number of correlations becomes so small 
that statistical significance is not obtained, 
but the trend is equally apparent in both the 
analysts and the fledglings and cannot be con- 
sidered to be the result of the difference in 
experience, In addition, agreement was slightly, 
although not significantly, better when the 
ratings were based upon typescripts rather 
than upon tape recordings, 

Data from the earlier study with the psy- 
chologists were further analyzed to permit the 
assessment of the effects of varying cases and 
conditions of presentation and context upon 
their ratings. The results of these analyses are 
presented in Tables 5 and 6. Once again, Case 
IV is seen to yield consistently lower inter- 
judge agreement, although the Median test 
reveals only the difference between Cases ITT 
and IV to be significant. There is no sig- 


Table 3 


Interjudge Reliabilities by Cases 
(Analyst-Fledgling group) 


Case Range Median 
I —.03 to .56 34 
H —.05 to .65 3i 
I .09 to .53 32 
IV —.15 to .48 16 


II, and III show significantly (p < .05) 
HS e a than Case IV. Cases I, II, and 


III do not differ significantly. 
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Table 4 


Interjudge Reliabilities by Conditions of 
Presentation and Context 


(Analyst-Fledgling group) 


Conditions Range Median 
“Identical 01to.56 3T 
bTotally different —.05 to .58 26 
“Identical context (TO) .05 to .65 32 
“Identical context (PI) 00 to.46 25 
“Identical presentation (RE) = 15 to..53 .25 
‘Identical presentation (TY) .03 to .53 31 


Note.—Identical vs. totally different—p < .05. d 
Therapist Only context vs. Preceding Interview con- 
text—p < .01. i 
* Includes only those correlations between raters operating 
under the same conditions of context and presentation. A 
b Includes only those correlations between raters operating 
under both different context and presentation conditions. r 
° Includes those correlations between raters operating under 
the Therapist Only context condition, irrespective of metho! 
of presentation, 
“Includes those correlations between raters operating under 


the Preceding Interview context condition, irrespective © 
method of presentation. 


“Includes those correlations between raters rating record- 
ings, irrespective of context condition. 


‘Includes those correlations between raters rating tyPe- 
scripts, irrespective of context conditions, 


nificant difference in interjudge agreement 
which can be attributed to different methods 
of presentation, and while ratings made under 
the preceding interview context condition yield 
slightly higher interjudge agreement than 
those made under the “therapist only” condi- 
tion, the difference is not significant. Addi- 
tionally, identical conditions of presentation 
and context produce no higher agreements 
among the psychologists than do totally differ- 
ent conditions. J 

Finally, comparisons were made of the in- 
terjudge reliabilities within and among the 
psychologist, analyst, and fledgling groups. In 
general, we find higher interjudge agreement 
among the psychologists than among either 
the analysts or fledglings. When ratings are 
made under identical conditions of presenta- 
tion and context, the psychologists yield 4 
range of interjudge reliabilities from .04 to .58, 
with a median of 42, while the comparable 
figures for the analyst group are — .01 to .56, 
median .22; and for the fledglings, .09 to 25; 
median .14. These differences among the 
groups, due to the small numbers of cases in- 
volved, are not significant. 

A comparison of the interjudge reliabilities 
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within each of the three groups’ ratings made 
under entirely different conditions of presenta- 
tion and context reveals a range of .07 to .62 
for the Psychologists, with a median of .42; 
Tange, .35 to .42, median .36 for the analysts; 
Tange —.02 to .43, median .31 for the fledg- 
lings. Once again, these differences fail to 
teach statistical significance, probably because 
of the small number of correlations involved. 

The amount of agreement among the three 
8roups was determined by a series of cross 
Correlations. That is, the ratings of the analyst 
Sroup were correlated with the ratings of the 
Psychologist group, the analysts with the 
fledgings, etc. These results may be sum- 
marized by saying that in general, the psy- 
Chologists agreed more with both the analysts 
and fledgling groups than the latter agreed 
With each other. 


Discussion 


This study supports our earlier evidence 
that raters are able to apply the Depth of 
nterpretation scale so as to differentiate be- 
tween interviews, and indicates further that 
€vels of experience and exposure to formal 
analytic training do not substantially modify 

Is ability. There is consistent evidence that 

e method of presentation of the interview 
Material (typescript vs. recording) has no ef- 
‘ect either upon mean level of rating or inter- 
Judge agreement, While the differences in level 
Of interjudge agreement among the three 
Sroups are small, there is a consistent tendency 
for the psychologist group to agree among 
hemselyes to a slightly greater extent than 
either the analysts or fledglings. In addition, 
We find that our hypothesis concerning the ef- 
fect of the increased sensitivity resultant from 
analytic training upon the perception of cues 


Table 5 
Interjudge Reliabilities by Cases 
(Psychologist group) 


Case Range Median 
I —.04 to .62 37 
Ir 113 to 63 ot 

Tr ‘31 to .64 £ 
IV —.05 to .73 . 


Note,—Significant difference between IIT and IV, p <.01, 
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Table 6 
Interjudge Reliabilities by Conditions of 
Presentation and Context 
(Psychologist group) 
Conditions Range Median 


“Identical 
>Totally different 


.04 to .58 A2 
-07 to .62 ~42 


‘Identical context (TO) -09 to .63 S 


dIdentical context (PI) —.05 to .64 43 
eIdentical presentation (RE) 04 to .59 AL 
‘Identical presentation (PI) .03 to .73 37 


Note.—None of the three comparisons reveals a significant 
difference. 

a Includes only those correlations between raters operating 
under the same conditions of context and presentation. 

b Includes ohly those correlations between raters operating 
under both different context and presentation conditions, 

e Includes those correlations between raters operating under 
the Therapist Only context condition, irrespective of method 
of presentation. 

d Includes those correlations between raters operating under 
the Preceding Interview context condition, irrespective of 
method of presentation. 

e Includes those correlations between raters rating recordings, 
irrespective of context condition. 

{Includes those correlations between raters rating type- 
scripts, irrespective of context conditions, 


provided by additional contextual information 
is not confirmed. Instead, we find the para- 
doxical result that among the analyst-fledgling 
group, additional context results in a signifi- 
cant decline in interjudge agreement. 

It may be possible to account for the gen- 
erally higher interjudge agreement among psy- 
chologists in terms of their greater familiarity 
with rating tasks of the sort demanded by 
these studies. This does not, however, explain 
why the analyst group was handicapped by 
the additional context. It is possible that when 
this group was faced only with the therapist 
responses, it was able to impose a generally 
more meaningful rationale upon the data than 
when the additional context provided a much 
larger number of alternative hypotheses. Per- 
haps with the fuller context of having reviewed 
all of the preceding interviews, the analyst 
group would tend to converge on a more 
unanimous judgment. The possibility that 
analytic training leads to a somewhat greater 
ability to entertain multiple alternative hy- 
potheses in the face of larger amounts of con- 
textual information should not be overlooked, 

Whatever may account for the few differ- 
ences between psychoanalysts and clinical psy- 
chologists in rating Depth of Interpretation, 
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it seems very clear that the two groups are 
essentially interchangeable as observers in 
studies which use this method of rating. Even 
though some may question the validity of this 
particular method of differentiating Depth of 
Interpretation, it is fairly representative of the 
commonly used methods. Therefore, one may 
proceed with the confidence that choice within 
this particular range of observers will not have 
profound influences on the results obtained. 

We continue to be troubled by the generally 
low reliability of the Depth of Interpretation 
scale, although we have previously demon- 
strated the possibility of increasing interrater 
agreement by means of specific instruction in 
the application of the scale, and by using rat- 
ings of somewhat larger segments of the inter- 
view. We continue to feel that the approach 
to psychotherapy research by means of re- 
sponse-by-response analysis is the most promis- 
ing of several alternatives, and are convinced 
that the variable Depth of Interpretation is a 
meaningful and useful one in psychotherapy 
research. A recent study by Speisman (8) 
lends support to this contention. 


Summary 


In order to explore the possibility that in- 
creased perceptual sensitivity to the subtleties 
of the therapy relationship would allow raters 
to increase their interjudge agreement in rat- 
ing Depth of Interpretation, four psycho- 
analysts and four analysts in training were 
enlisted as expert judges. These judges rated 
four therapy interviews under different condi- 
tions of presentation and context. 

An analysis of variance carried out on a 
modified latin-square design revealed that 
these raters could distinguish between inter- 
views, but that neither the method of presenta- 
tion of the interviews nor the amount of con- 
textual information available to the judges had 
any systematic effect upon the means of re- 
sponse-by-response ratings. 

A correlation analysis revealed that this 
group of raters had generally lower interjudge 
reliabilities than a group of psychologists who 
had previously rated the same interviews 
under the same conditions. The analyst-fledg- 
ling group among themselves showed signifi- 
cantly better interjudge agreement when their 
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ratings were made under conditions of minimal 
context (therapist only condition) than when 
increasing amounts of context were available 
(preceding interview condition). 

These results were discussed in terms of the 
greater familiarity of psychologists with rating 
tasks of the sort used, and the possibility was 
raised that analytic training made it possible 
to entertain a greater number of alternative 
hypotheses (and thus to decrease rating relia- 
bility) in the face of added contextual infor- 
mation. The essential identity of the two 
populations of judges was pointed out, and it 
was suggested that one may proceed with the 
confidence that choice within this particular 
range of observers will not have profound in- 
fluences on the results obtained in studies 0 
which this and similar rating scales are used. 


The implications of the study for the con- ` 


tinued application of the Depth of Interpreta- 
tion rating scale to the process analysis of PSY 
chotherapy were discussed. 
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One of the problems which confronts most 
mental hygiene clinics is premature termina- 
n n of psychotherapy. Many patients 80 

rough all the admission procedures, begin a 
course of long-term therapy, but discontinue 
treatment after only a few sessions. 

Several articles have dealt with the possible 
causes of premature termination of therapy 
(2, 7, 9, 10, 18) and a number of attempts 
have been made to predict which patients will 
terminate (3, 12, 14, 15, 17, 22). Most of the 
Prediction studies have been concerned with 
the personality of patients, as inferred from 
test records and biographical data, that might 
be related to their unwillingness to remain in 
treatment. Very few studies have dealt with 
characteristics of therapists which might be 
responsible in part for patients discontinuing 
therapy. 

The present study is an attempt to discover 
Whether different types of therapists tend to 
lose or hold in treatment different types of 
patients. It is not concerned with differences 
3 the drop-out rate for different therapists, 
ha rather the type of patient most apt to con- 

ue or discontinue treatment with various 
pes of therapists. It is thus a study of pa- 
tient-therapist compatibility. It is therefore in 
line with the contemporary emphasis on field 
theory, which conceives of therapy as an in- 
terpersonal process in which the patient’s be- 
havior and growth are seen not as 4 function 
of the patient’s personality alone, nor of the 
therapist’s personality and skill alone, nor the 
mere sum of these, but is rather dependent on 
the particular nature of the interaction be- 
tween the patient’s characteristics and the 


1This article is based on a doctoral dissertation 
submitted to the Department of Psychology, Univer- 
sity of Michigan, 1953. The author is now at Agnews 
State Hospital. 


therapist’s characteristics. The results of such 
studies could eventually be put to use for the 
purpose of selecting the therapist most suitable 
for each patient. At present, patients are as- 
signed to or selected by therapists at random 
or else on an intuitive basis rather than on the 
basis of empirical research. 


In studies reported previously (14, 15) dealing 
with the prediction of premature termination of psy- 
chotherapy by means of the Rorschach test, it was 
found that the total number of responses given 
turned out to be the best predictor. Three other 
studies have reported somewhat similar findings (3, 
12, 17). In a number of clinics, therefore, it appears 
that patients who drop out of treatment within a 
few sessions usually give fewer responses on the 
Rorschach than patients remaining in treatment for 
a longer period of time. 

A high response total on the Rorschach has been 
attributed to or found related to a number of per- 
sonality and attitudinal variables including: produc- 
tivity (5, 24), achievement (26), intelligence (3, 20), 
verbal fluency (24), ego-involvement in the task 
(8), cooperativeness (3), responsivity (6), ease at 
forming associations (1), conflict awareness (25), 
high energy level (6), and jnitiative (24). Low re- 
sponse total has been attributed to excessive use of 
repression (16, 25), depression (5), incapacitating 
anxiety (11), passivity (24), a tendency to give up 
easily (24), and a hysterical indifference towards 


symptoms (24). 


The response total on the Rorschach seems thus to 


be related to a number of intellectual, temperamental, 
and motivational variables, all reflecting a type of 
productivity or drive which one would expect to be 
required for active participation in psychotherapy. 
In fact some studies have reported statistically sig- 
nificant relationships between the number of Ror- 
schach responses given by the patient and ratings of 
improvement in psychotherapy (21, 23). 


Although for the clinic as a whole, patients 
who were unproductive on the Rorschach 
tended to drop out of therapy prematurely, it 
was noticed by the author that for a few 
therapists this general finding did not seem to 


341 


342 


apply. Whether or not productivity on the 
Rorschach differentiated between patients re- 
maining and patients terminating seemed to 
depend on which therapist was doing the treat- 
ment. A series of studies was therefore carried 
out to determine whether different types of 
therapists tended to hold in treatment different 
types of patients and, specifically, whether 
some therapists are able to hold in treatment 
the unproductive or unmotivated patients who 
usually do not remain long in treatment, and 
whether some therapists lose many of the pro- 
ductive and motivated patients who usually 
remain in treatment. 


Subjects and Setting 


The present study was carried out in the VA 
Mental Hygiene Clinic at Detroit, Michigan. 
The subjects are therefore veterans (almost all 
males) who applied for or were referred for 
psychotherapy at this clinic. All such patients 
are entitled to free psychiatric treatment be- 
cause of a service connected disability. Many 
are referred for treatment after a routine pen- 
sion examination and often have the erroneous 
impression that their pension will be jeopard- 
ized if they do not report for treatment, and 
some have misgivings about the fact their 
pensions will be taken away if they recover as 
a result of treatment. 


A wide variety of diagnostic categories are repre- 
sented among the patients at this clinic, the most 
common being anxiety reaction, Psychoneurosis, latent 
schizophrenia, and character disorder. Almost all the 
patients are from urban areas. Most are employed as 
skilled or unskilled factory labor; some hold clerical 
or sales positions; only a few are in the professions 
or are business executives. The socioeconomic level 
of the patients is predominately lower and lower- 
middle class. About half the patients had not com- 
pleted high school. Upon admission to the clinic the 
patients are interviewed and usually are given the 
Rorschach test and one or two other Psychological 


tests. 

The therapists at this clinic are for the most 
part analytically oriented and tend to em- 
phasize long-term methods of therapy. Thus 
most patients remaining less than 20 sessions 
are considered to have terminated before com- 
pletion of the treatment. 


Procedure pais 


ae 
ients seen by certain - 

e records of patien i 
Pe k were taken from the files and clas-> . 
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sified with respect to duration of therapy. AS 
in the previous study (14), only extreme cases 
were used. Patients dropping out of treatment 
within five sessions without extenuating on 
cumstances or the therapist’s recommendation 
were considered to have terminated prema- 
turely. Those remaining at least 20 sessions 
met our criterion for remaining in treatment. 
In the Detroit VA Clinic, about 40% of the 
patients terminate within five sessions and 
about 30% remain in treatment 20 or more 
sessions. 3 

The patients were then further characterized 
in terms of their productivity on the Ror- 
schach test. Patients giving 25 or more Ror- 
schach responses were classified as “pro- 
ductive,” and patients giving less than 25 
Rorschach responses were classified as “un- 
productive.” 

A series of six statistical analyses was then 
carried out to determine whether the amount 
of difference in Rorschach productivity Þe- 
tween the remainers and terminators is Te 
lated to the following therapist variables: 
(a) unspecified differences between individual 
therapists, (b) the professional training of the 
therapist, (c) the sex of the therapist, (d) the 
warmth of the therapist, (e) the competence 
of the therapist, and (f) the passivity of the 
therapist. 

In order to characterize the therapists along 
these last three dimensions, ratings were 0b- 
tained on all the therapists whose patients 
were used in this study. Ratings were made bY 
the three staff psychologists who were best 
acquainted with a large number of therapists 
at the clinic. The ratings were made on 4 
three-point scale in which each rater charac- 
terized each therapist as being average, above 
average, or below average on three different 
variables: warmth, competence at analytically 
oriented therapy, and passivity. The raters 
were instructed to assign an approximately 
equal number of therapists to each category 
on the rating scale. The statistical analyse’ 
used patients of therapists falling near the 
extremes of these continua as reflected bY 
agreement by two out of three of the raters 
that the therapist was either above or below 
‘average, the third rater not being in direct 


“contradiction. 


The following specific hypotheses related tO 
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these rated characteristics of the therapists 
were formulated and tested: 

1. Therapists who appear warm and friendly 
are able to hold in treatment more of the un- 
Productive or less motivated patients than 
therapists who appear somewhat cold and 
distant. Being with a warm and friendly per- 
Son may be a source of comfort to unproduc- 
tive and, hence, probably inadequate indi- 
viduals, and may serve to motivate some of 
the patients who were not very motivated to 
undergo psychotherapy at the time they were 
tested. 

2. Therapists who are highly competent at 
analytically oriented therapy lose fewer well- 
motivated, productive patients than therapists 
who are less competent. Although a competent 
therapist may lose many unmotivated or un- 
Productive patients, because such patients 
may not be suitable candidates for analytically 
Oriented therapy, he should not lose many 
Productive and well-motivated patients. There- 
fore, loss of such patients was held to be due 
to errors in therapeutic technique, which are 
likely to be made more often by the less 
Competent therapists. 

3. Extremely passive therapists hold in 
treatment fewer of the unproductive patients 
than therapists employing a more active pro- 
cedure. It was felt that the unproductive pa- 
tients included many who were passive de- 
pendents and needed a relatively active thera- 
Pist to lean on or else they would become 
discouraged and give up. 


Results and Discussion 


Unspecified Differences Between Individual 
Therapists 


In order to determine whether individual 
therapists differ in regard to the type of Pa- 
tients they are able to hold in treatment, SIX 
therapists were selected who had been at the 
clinic a long time. A search of the files dis- 
covered, for each therapist, seven patients who 
remained in treatment at least 20 sessions and 
seven patients who terminated within five ses- 
sions. The number of Rorschach responses of 
each patient was noted and a nonparametric 


343 


Table 1 


Median Number of Rorschach Responses Given by 
the Remainers and Terminators of 
Different Therapists 


Therapists 
Patients AB. (C.D een, 
Terminators 22 18) 2L 16r RL AS 
Remainers 19° (35 32- "6579 18 ESS 


in patients’ productivity associated with (a) 
the therapists’ selection of patients, as would 
be reflected in differences between the median 
number of responses of different therapists’ 
patients in general, and (b) over-all differ- 
ences in scores between remainers and ter- 
minators in general; thus leaving the sole 
source of variation the patient-therapist inter- 
action component. 

A significant amount of patient-therapist 
interaction was found (p= .01), which im- 
plies that individual therapists do differ in 
regard to the type of patients tending to con- 
tinue or discontinue treatment. 

Table 1 shows the median number of Ror- 
schach responses of the remainers and ter- 
minators of each of the six therapists. It will 
be noted that for two of the therapists there 
was no appreciable difference in Rorschach 
productivity between the remainers and ter- 
minators. For the other four therapists, how- 
ever, the patients who remained in treatment 
gave about twice as many responses as those 
terminating. Thus remainers and terminators 
differ in Rorschach productivity for certain 
therapists but not for others. Some therapists 
are able to keep the unproductive patients in 
treatment, other therapists are not. It follows, 
therefore, that whether or not Rorschach pro- 
ductivity can be used to predict continuance 
in therapy depends to some extent on the type 
of therapist involved. The over-all difference 
in Rorschach productivity between the re- 
mainers and terminators for this particular 
2 peer previously (14, 15), implies 
; of the therapists in this clinic are 
lik s B, C, D, ana F, rather than 


analysis of interaction was carried T r lO ther clinics made be 
manner recommended byg iay aeae ‘ 8 stsqfikegA and E would probably And uo 
analysis permits eliminat pa ig variabilityhal b Réant difference in Rorschach produc 

pave ac $ 
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tivity between patients remaining in treatment 
and patients terminating prematurely. These 
findings may account for some of the incon- 
sistencies in the reports from different clinics 
concerning their attempts to predict premature 
termination of therapy from the Rorschach 
(3,4; 12; 45, 17, 22). 


Professional Training of the Therapist 


In order to determine whether the profes- 
sional training of the therapist makes any dif- 
ference in regard to the type of patients most 
apt to continue or discontinue treatment, 78 
patients (39 remainers and 39 terminators) 
were categorized according to the professional 
» Psychiatrist, 
or psychiatric social 


is a Psychiatrist, clinical 
or psychiatric social worker 


ing to remain in treatment 


Sex of the Therapist 


Table 2 


Median Number of Rorschach Responses Given by the 
Remainers and Terminators of Therapists 
Categorized with Respect to Sex 


Therapists 
———__, 
Patients Male Female 
Terminators (V=40) 15:5 25.0 
Remainers (N=40) 30.5 22.5 
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workers. Patients seen by psychiatrists were 
not used since there were no female psy- 
chiatrists at the clinic. ] 

The result of the analysis of interaction 
was significant at the .05 level of confidence, 
suggesting that the sex of the therapist is a 
factor determining whether a given type of 
patient will remain in treatment or not. Table 
2 indicates the median number of Rorschach 
responses given by the patients remaining and 
the patients terminating treatment with male 
therapists and female therapists. 

It will be noted that productivity on the 
Rorschach is not related to continuance in 
therapy with the female therapists employed 
at this clinic, whereas it is associated with 
continuance for patients seen by male thera- 
pists. 

Of course it would be unwise to generalize 
this finding to female therapists in general 
since the records of patients seen by only 
seven female therapists, all employed in a 
single clinic, were used in this study. How- 
ever, it is clear that in the Detroit VA Clinic, 


at least, the female therapists were able to 
keep in treatment man 
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Table 3 


Rorschach Productivity of Patients Remaining in 
Therapy with Therapists Categorized 
with Respect to Warmth 


No. of patients Proportion 
seen at least who gave 
= 20 sessions by less than 25 
Kind of each type of Rorschach 
therapist therapist responses 
Ee ogee 
Warm 32 63% 
Cold 38 24% 


anole t ass, p= -0005, A one-tailed test was used. to 
Á gnificance level since the direction of the ditter- 
ence had been predicted. i 


Personality and Ability of the Therapist 


A series of three statistical comparisons was 
carried out designed to test the hypotheses 
presented in the procedures section. 

Since it was hypothesized that the warm 
and friendly therapists hold in treatment more 
of the unproductive patients than do the cold 
and distant therapists, the proportion of un- 
preditivo (R less than 25) patients among 

Nose remaining in treatment with the thera- 
Pists rated most warm was compared with the 
Proportion of unproductive patients among 
those remaining in treatment with the thera- 
pists rated least warm. 

The results shown in Table 3 confirm the 
first hypothesis. Of those patients who re- 
mained in therapy with cold therapists, 767 
pave productive Rorschachs and only 24% 
ori not Productive, whereas of the patients 

‘ho remained in treatment with warm thera- 
pists, 63% were not productive. Thus the 
Cold therapists tended to keep in treatment 
only the productive well-motivated patients, 
Whereas the warm therapists were able to 
keep in treatment a sizeable proportion of the 
unproductive or less motivated patients as 
well. In fact, the proportion of unproductive 
patients who remained in treatment with the 
warm therapists corresponds closely to the 
proportion of unproductive patients in the 
total intake population at this clinic. There- 
fore, if the patient is assigned to a warm and 
friendly therapist, productivity on the Ror- 
schach can not be used to predict whether or 
not he will remain in treatment. 

The fact that the warm therapists are able 
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to hold in treatment the unproductive patients 
as well as the productive ones may or may not 
be desirable. One would have to know some- 
thing about the outcome of the treatment in 
order to tell. Perhaps some patients who are 
really unable to benefit from analytically 
oriented psychotherapy will remain in treat- 
ment because they enjoy the warm and friendly 
behavior of the therapist toward them. The 
treatment of other patients, who could derive 
some real benefit from therapy, might thus be 
delayed or prevented, since each therapist can 
only see a limited number of patients. 

Since it was hypothesized that the most 
competent therapists lose fewer productive 
well-motivated patients than the least com- 
petent therapists, the proportion of productive 
patients among the terminators seen by the 
most competent therapists was compared with 
the proportion of productive patients among 
the terminators seen by the least competent 
therapists. The findings summarized in Table 
4 confirm the second hypothesis. Therapists 
rated as most competent at analytically 
oriented therapy do lose a significantly (p 
= .03) smaller percentage of productive well- 
motivated patients than therapists rated as 
least competent. 

The third hypothesis was not confirmed by 
the findings. Rated passivity of the therapist 
was not found to be significantly related to 
whether or not unproductive patients would 
remain in treatment. Either the theory which 
led to this prediction was in error or else the 
ratings of passivity did not really reflect the 
therapist’s behavior in therapy. 


Table 4 


Rorschach Productivity of Patients Breaking Off 
Therapy with Therapists Categorized 
with Respect to Competence 


No. of patients Proportion 

breaking off who gave 

with each 25 or more 

Kind of type of Rorschach 

therapist therapist responses 
Most competent 38 29% 
Least competent 20 55% 


Note.—t = 1.94, p =.03. A one-tailed test was used_ to 
compute the significance level since the direction of the differ- 
ence had been predicted. 
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Because of the exploratory nature of this 
study, only a few of the many possible anal- 
yses were made and only the most obvious 
hypotheses were tested. However, the method 
used appears to be a useful one and may war- 
rant further consideration. It is suggested that 
patients be characterized on a number of 
variables other than mere productivity. For 
instance, social class, intelligence, anxiety, 
hostility, depression, introversion, Passive de- 
pendency and its reaction formation, homo- 
sexuality, paranoid tendencies, schizoid tend- 
encies, psychopathy, over- or undercontrol of 
affect, etc. might be important variables on 
which patients could be characterized, Like- 
es of possible im- 
effective therapy 
nts might be used 


regarding the best 
type of patient. As 
tibility, it may be 


A stud 
Mental 
therapists 
patients tendi 
break off Prematurely, and, 
acteristics of the therapists 


treatment or 
if so, what char- 


Sex, warmth, 
nted therapy, 
stical analyses 
Tmine whether 
these therapist traits were related to the Ror- 


S continuing or 


The results were as follows: 
1. Therapists in general differ in regard to 
the type of patients who continue 


or discon- 
tinue treatment with them. 


E. Wesley Hiler 


2. Whether the therapist is a psychiatrist, 
clinical psychologist, or psychiatric social 
worker seems unrelated to the type of patients 
who continue or discontinue treatment. 

3. Whether the therapist was male or fe- 
male did make a difference. The female thera- 
pists tended to keep in treatment more of the 
unproductive patients but also tended to lose 
slightly more of the productive patients than 
did the male therapists. 

4. Therapists rated as most warm and 
friendly were able to keep in treatment a 
larger percentage of unproductive patients 
than therapists rated as least warm and 
friendly. 

5. Therapists rated as most competent at 
analytically oriented therapy tended to lose 
fewer productive patients than therapists rated 
as least competent. 

6. Rated passivity of the therapist seemed 
unrelated to the Productivity of patients re- 
maining in therapy, 

It was suggested 


that the methods em- 
ployed in this study 


of premature term; 
add to the clini 
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The Relationship 


of Stimulus Ambiguity on 


the TAT to the Productivity of Themes' 


Bernard I. Murstein 
University of Portland 


One of the problems confronting the cli- 
nician is the relationship of the ambiguity of 
TAT cards to the stories elicited. Medium- 


group and the 


Bijou group were: Regression of Productivity 
on ambiguity, Bijou males y 07, » 61, (p 
< 10); Bijou females 7 03,9 43, (pe 60); 


Bijou total 7 09, » .86, p< 001). Regres- 
sion of ambiguity on Productivity, Bijou 
males 7 .07, » .95, (p < 001); Bijou females 


1An extended report of this study may be ob- 
tained without charge from Bernard I, Murstein, 
Psychology Department, University of Portland, 
Portland 3, Oregon, or for a fee from the American 
Documentation Institute. Order Document No, 5695, 
remitting $1.25 for microfilm or $1.25 for photo- 
copies. 


7 03, » 43, (p< .60); Bijou total 7 .09, 
7.73, (p < 01). } 

The results indicate the significant curvi- 
linear relationship and nonsignificant linear 
relationship between ambiguity and produc- 
tivity. The curvilinear relationship was such 
that a medium degree of ambiguity elicited 
maximum productivity, while both high and 
low ambiguity resulted in less productivity. 
The smaller degree of relationship found when 
using the Bijou female group was probably 
a function of the “male series” of cards and 
the difference in sex from the all-male Eron 
group. 

A perusal of the TAT cards yielded the 


opinion that the moderately ambiguous cards 
were, fi 


l ‘personality revealingness” is 
obtained from vague stimulus figures or from 
clear stimulus figures whose feelings or ac- 
tivities are not readily apparent. 

Brief Report, 

Received May 26, 1958, 
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Countertransference Effects in Psychotherapy" 


Richard L. Cutler 


University of Michigan 


seen’, therapist's personality has long been 
see as one of the most important vari- 
a 4 in psychotherapy. Psychoanalytic writers 
ee repeatedly the importance of a 
out Ta fia for the therapist, pointing 
mule is eleterious effects upon the treatment 
anita of ìs unresolved conflicts may have. In 
Hite o this emphasis in the theoretical litera- 
little and in practice, researchers have had 
the „Success in their attempts to investigate 
E influence of the therapist’s personality 
pon his conduct of psychotherapy. 
ead reasons for this lack of success are 
diffe: ae apparent. The first, the extreme 
che culty in the operational definition of psy- 
pag hg concepts, is common to all re- 
X ch on the psychoanalytic theory of per- 
onality, The second is unique to research in 
Psychotherapy, particularly to that dealing 
with countertransference. It is the fact that 
most therapists, having training in at least 
me ne iments of personality theory and psy- 
fee. iagnosis, do not readily drop their de- 
mses to allow us to examine their conflicts 
and inner feelings, at least not short of the 
analytic couch. 


Problem 


The present study approaches the problem 
of the manifestation and effects of counter- 
transference through a reinterpretation of the 
Concept in terms of Bruner’s theory of per- 
ception. In this way, some of the operational 
Problems are overcome. In addition, by means 
of a rating device developed specifically for 
the purpose, it allows the identification of 


1 This study was made possible by the support of 
USPHS. Project M-516, “Analyses of Therapeutic 
Interaction,” E. S. Bordin, Principal Investigator. 
The author wishes to thank all staff members whose 
cooperation made it possible. 


conflict areas in the therapist’s personality, 
and the prediction of their effects upon the 
moment-to-moment interaction between pa- 
tient and therapist. 

Countertransference, as examined in this 
research, is defined as the transference reac- 
tions of the therapist to his patient. Fromm- 
Reichmann (8) defines transference in its 
most general sense as “the process of trans- 
ferring to and repeating early patterns of in- 
terpersonal relatedness with present day part- 
ners.” In its special application to the thera- 
peutic relationship, she points out that it 
means transferring onto the therapist, with no 
or minimal basis in the realities of the situa- 
tion, early experiences in interpersonal re- 
latedness. 


Fenichel (4) discusses transference in terms of im- 
pulses arising and being experienced which are in- 
appropriate to the situation in which they arise. He 
emphasizes the tendency of the person experiencing 
transference reactions to attempt to reconcile the ex- 
perience of the inappropriate impulses with the re- 
alities of the situation, and thereby to distort these 
realities to fit the demands of his own needs. He 
agrees with Freud (7) in terming the appearance of 
such distortions in the therapist as countertrans- 
ference. 

Herman Nunberg, speaking as a member of a 
panel on “Problems of Transference and Counter- 
transference,” dealt with the relationship between 
the unconscious needs of a person and his percep- 
tions of reality. He says: «|. the patient desires to 
find satisfactions for his needs in the person of the 
analyst, and attempts to change him into an object 
which will provide this satisfaction. He is frustrated 
because the analyst is not this object” (9, p. 26). 

From this point of departure, Nunberg sketched. 
the following picture: We carry within us images of 
the need-satisfying objects of old and try to find 
them in the outside world. We seek something in re- 
ality that is exactly like them and desire to bring 
about an identity between the perception of present 
objects and the images within us. The patient may 
unconsciously try to change reality so as to con- 
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i i i ize upon some 
with the inner picture, or may seize ı 
ea the present reality which is similar to the 
desired object, and, aided by such detail, Project his 
inner images upon the current reality. This process 
Nunberg sees as transference. 


We find a parallel formulation by Bruner 
(2) in the field of perception. Postulating a 
three-step process in perception, which con- 
sists of (a) hypothesis (set, Aufgabe, deter- 
mining tendency); (b) input of information 
from the environment; and (c) confirmation 
or infirmation of the hypothesis, Bruner con- 
siders in detail the influence of need upon 
perception. Hypothesis strength, a central 
concept in Bruner’s theory, is in part de- 
pendent upon the consequences which the 
particular hypothesis has in aiding the organ- 


ism in the fulfillment of needs. The more 


basic the confirmation js to the carrying out 
of need-satisfyin 


§ activity, the greater will be 
its strength, Bruner states three theorems 


which are. Contingent upon this Concept of 
hypothesis strength: 


1. The stron 


the greater its like- 
lihood of arou i 


sal in a given Situation 


the hypothesis, the 
appropriate information neces- 


Thus it can b 
fying hypothese 


e basis of minimal appropriate information 
from th i 


The above formulation 
proach the problem of 
from the frame of reference of the influence 
of the therapist’s needs upon his Perception 
of his own and the patient’s behavior in psy- 
chotherapy. If the formulation is valid, we 
should find certain systematic relationships 
between the needs and conflicts of the thera- 
pist and his ability to report objectively the 
behavior of himself and the patient in psy- 
chotherapy. When no conflict is present, and 


permits us to ap- 
countertransference 
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no defensive countertransference reactions are 
necessary, he should perceive and report KE 
behavior with relative objectivity. On l 
other hand, when the stimulus situation is 
such that material impinges upon the thera 
pist’s needs and conflicts, we should find sys 
tematic tendencies to omit, distort, or over 
emphasize certain aspects of the behaviog 
This discussion leads to the first major hy- 
pothesis of the study: In reporting his E 
havior and that of the patient, the therapis 
will over- or underemphasize material re- 
lated to his own needs and conflicts as co 
pared to material which is related to rela 
tively conflict-free areas in his personality. 
If such effects do indeed result from the 
influence of the therapist’s needs, it follows 
that there will be certain consequences for 
the process of therapy itself. One of thess 
may be a rather gross misjudgment of wha 
the patient’s characteristic interpersonal rela- 
tionships are like. In practice, however, steps 
are taken to prevent such gross errors by the 
therapist. By means of supervisory sessions 
and the utilization of projective tests, it is 
possible to check the therapist’s judgments 
against less involved and more objective cri- 
teria. However, in the moment-to-moment in- 
teraction between therapist and patient, there 


is little immediate Opportunity to control the 
distortions of the therapi. 


on the process of therapy- 


Stekel (10) says, “. . . scotomata in the 


therapist due ti 


ndependently from the “need- 
ption” frame of reference. Sup- 


operation may 
distortion by th 
tient is doing, 
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attention and energies must necessarily be 
diverted away from the task of psychotherapy 
to the equilibrium-restoring process of de- 
fense. This will then become evident in a less 
adequate handling by the therapist of such 
Conflict-relevant material. The above discus- 
sion leads to the second major hypothesis of 
the study: When behavior exhibited by the 
Patient is similar to behavior which has been 
identified as conflictual for the therapist, the 
therapist’s responses to this behavior will be 
judged to be significantly less adequate for 
therapeutic purposes than his responses to 


oe which is relatively nonconflictual for 
am, 


Procedure 


Therapist conflict areas were identifed by 
a method which consisted essentially of com- 
paring therapist’s self-ratings on certain per- 
sonality traits with ratings made by judges 
who were attempting to describe the same 
therapist with regard to the same personality 
traits. Similar self-vs.-judge ratings have been 
used previously by other investigators, and 
the reliability of such ratings was sufficiently 

igh to encourage their use in the present 
study (1, 5). The personality traits on which 

ke therapists and judges were asked to make 
ratings were derived from a device called 
The Circle” (6) which had been developed 
Specifically for the purpose of categorizing in- 
terpersonal relationship materials of the kind 
found in therapy recordings, TAT stories, etc. 
The use of conflict and nonconflict areas based 
directly upon this coding system permitted a 
direct relating of the therapist need areas 
to the material collected in his therapy 10- 
terviews and reports. An attempt was made 
to select words which would be descriptive 
of meaningful personality traits, and which 
would also adhere closely in meaning to the 
various points on the Circle. The sixteen ad- 
jectives finally selected are listed below: (Let- 
ters denote code category on the Circle.) 


A. Dominating I. Submissive 
B. Boastful Je Respectful 
C. Rejecting K: Dependent 
D. Punitive L. Agreeable 
E. Critical M. Affiliative 
F. Complaining N. Supportive 
G. Suspicious ©. Generous 
H. Apologetic p. Advising 
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Each subject therapist was asked to place 
on a 19-point scale, from “most character- 
istic” to “least characteristic,” each of the 16 
traits as he felt it applied to himself in his 
day-to-day dealings with people. Nine or more 
judges, each of whom was personally well ac- 
quainted with the therapist he rated, carried 
out the same task, i.e., he rated each of the 
16 traits as he felt it applied to the subject 
on the basis of his day-to-day personal and 
professional contact with the subject. 

Conflict areas were identified as those traits 
which showed a significant disagreement * be- 
tween the self-rating of the therapist and the 
judges’ ratings. The assumption upon which 
this procedure rests is as follows: judges’ rat- 
ings of a therapist are based upon how the 
therapist actually behaves in relation to each 
judge. If the therapist overrates or underrates 
himself on a particular trait, it is because he 
is unable to see himself as he really is. The 
reason for this lack of objectivity is conflict 
which the therapist has over the expression 
or nonexpression of the particular trait. 

Using this technique, two types of conflict 
could be distinguished. The first, consisting 
of those traits on which the therapist over- 
rated himself as compared to the judges’ rat- 
ings of him, will hereafter be denoted as 
“plus-conflict.” The second type, in which the 
therapist underrated himself, will be called 
“minus-conflict.” Traits were judged to be 
relatively conflict-free for a subject when the 
judges’ ratings clustered symmetrically about 
the therapist’s self-rating. It is obvious that 
the total of the traits identified as conflict 


2 The statistic used to establish significance of dis- 
agreement between subjects’ self-ratings and judges’ 
ratings was the “sign test.” This is a nonparametric 
statistic which does not require the assumption of 
underlying normality of the population of judges’ 
ratings on @ particular trait. It merely requires that 
each judge’s rating can be categorized as “higher” or 
“Jower” than the subject’s rating on any particular 
trait. Significance tables are available for this sta- 
tistic and reveal that with nine judges, an 8-1 split 
js significant at the 05 level, and a 9-0 split is sig- 
nificant at the .01 level (3). In cases where the sub- 
ject’s rating on a trait tends toward the extreme of 
the rating scale, the sign test becomes increasingly 
less applicable, so that trait judgment discrepancies 
which were the result of the subject rating himself at 
one of the extremes of the scale were not used as 
conflict areas. 


— 
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areas plus those identified as conflict-free or 
neutral will not account for all of the 16 be- 
havior traits in each subject. In those cases 
where neither an identification of “conflict” 


made, it was felt that 


about these traits. 
In all, ten subjects were Pretested in order 


ere selected for the major 
y. The major factor in the 


? 
Operate, and availability of 
patients were also involved, 


ad no per- 


He recorded four con- 


therapy hour. These 


not less 
than 500 words long, and included 


his im- 


and vocal expressions 
the actual verbal] content, 
The interviews were coded on the Circle, 
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This summation Was assumed to be the K, 
jective picture of the behavior of the nerap 
and his patients during the series of inter % 
views. PO 
A similar coding was carried out on l 
therapist reports. By summing the number 0° 
occurrences of each of the 16 behaviors — | 
all the reports of a given therapist, a pictur a 
was obtained of each therapist’s perception 0 
is own and his patients’ behavior. n 
The coding reliability of the categorizatio 
scheme for interview and report material a 
established by spot-checking interviews whi 
were randomly 
One judge coded the entire set of interviews; 
another coded 
a third coded 


S partial agreements ne 
he three interviews, a 
agreement ranged from 62% to 71%, part 


agreement from 24% to 33%, and disagree- 
to 10%. The reliability esti- Pi 


i a single res onse ist or patient 
might contain one, eo el i category 
Steement Was possible. The rule 0 
ed for determining complete agree- 
ent, and disagreement was as 
Codes for a given response 
aS complete agreement indi- 
more corresponded, it was Tar 
t; and when less than ha 
idered a disagreement. 


= 
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three such tests yielded 7’s of .75, .81, and 
‘84, and were interpreted as indicating that 
the reports could be reliably coded by inde- 
pendent judges. In view of the fact that only 
' the total number of appearances of each trait 
in the reports entered into the testing of the 
hypotheses, it was felt that demonstrating 
point-to-point agreement among the judges 
Was not necessary so long as the total num- 
ber of codings for each trait agreed to the 
€xtent indicated above. 

Specific predictions were made regarding 
the relative accuracy of the therapist’s re- 
Ports of behavior which had been identified 
as conflictual as compared to the reports of 
behavior identified as neutral. For the thera- 
Pist’s reports of his own behavior, it was pre- 

dicted that he would systematically overreport 
those occurrences of behavior in himself which 
had been identified as plus-conflict, and un- 
derreport those which had been identified as 
minus-conflict. i 

Concerning the therapist’s perception of the 
behavior of his patients, it was predicted that 

is reports, compared with the actual nuraber 
of occurrences of a given type of behavior, 
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would differ significantly from his reports re- 
garding neutral material. 

In order to test the hypothesis concerning 
the adequacy of the therapists’ handling of 
conflict vs. neutral material, each therapist 
response was coded by an independent judge 
as being either “task-oriented”? or “ego-ori- 
ented.” By definition, task-oriented behavior 
was any behavior on the part of the therapist 
which tends to produce or facilitate in the pa- 
tient a flow of therapeutically relevant con- 
versation, while ego-orientation involves thera- 
pist behavior which departs from this task for 
the apparent purpose of expressing the thera- 
pist’s own needs. Thus, a consistent tendency 
on the part of the therapist to use ego-ori- 
ented mechanisms will result in a lessened 
therapeutic efficiency and a consequent slow- 
ing down of the patient's progress. 

We may consider ego-oriented behavior as 
a form of defensive activity on the part of the 
therapist. So long as the patient’s productions 
do not impinge upon conflict areas, there is 
little need for the therapist to indulge in such 
defensive activity, and he will adhere to the 
task of psychotherapy. However, when the 


Table 1 
Results: Therapist 1 


Therapist self-report vs. 
actual occurrence 


Therapist report of pt. vs. 
actual occurrence 


Re- Pre- Si enifi- Re- Pre- Signifi- 
A Dombate 7 ] 25 17 = n 7 5 a ate 
B Sea eg 1 1 None — 64 60 None O18 
C Rejecting — 2 8 None 001° $ 49 None 001s 
D Punitive Plus 5 11  Overreport 01 4 18 Disparity .001 
E Critical Plus 1 12 Overreport .001 1 39 Disparity 001 
F Complaining Plus 1 0  Overreport > 96 47 Disparity .50° 
G Suspicious Plus 4 13 Overreport .001 5 28 Disparity .001 
H Apologetic aai 5 2 None -— 128 74 None l au 
I Submissive Plus 2 4  Overreport oe 11 16 Disparity .01 
J Respectful — 185 19 None 0012 35 33 None .012 
K Dependent Plus 0 4  Overreport  .02 26 $1 Disparity 01 
L Agreeable Minus 77 g  Underreport .001 115 53 Disparity .50° 
M Affiliative Minus 11 1 Underreport .05 6 35 Disparity .001 
N Supportive — 14 39 None .001° 0 0 None pia 
O Generous Minus 94 70 Underreport .10 6 3 Disparity .50° 
p Advising Neutral 191 99 — — 226 116 -£ po 


i Significant disparity where no prediction was possible. 
Š N insufficient to permit significance test. 
Unverified prediction. 
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Table 2 
Results: Therapist 2 


Therapist self-report vs. 
actual occurrence 


Therapist report of pt. vs. 
actual occurrence 


-  Signifi- 
Code Trait Conflict Actual Ported diction cance Actual porte 

isparit 01 

A Dominating Minus 23 3 Underreport 01 0 o PERY ‘001 
B Boastful Plus ik 0 Overreport — 62 21 Disparity 001 
c Rejecting Plus 4 15 Overreport 01 4 Disparity 10 
D Punitive Minus 13 0 Underreport 001 7 9 Disa ‘oot 
E Critical Plus 0 O — Overreport — 0 15 we ‘ole 
F Complaining — 4 2 None .50 131 FM Disparity 1001 
G Suspicious Plus 1 8 Overreport 01 4 Disvacty, 0c 
H Apologetic Plus 14 6  Overreport “ Y H ane y ‘ole 
Submissive — 3 5 None St ae sg 01 

i Respectful Minus 119 4 Underreport 001 87 25 eset id a 
K Dependent — Plus 0 1 Overreport ` _» 5 15 Dispari y ‘001 
E Agreeable Plus 29 54 Overreport 001 97 34 Disparity ‘ole 
M sAffiliative — 14 16 None 058 9 24 None p 
N Supportive Neutral 128 77 == — 3 3 ae 50° 
(0) enerous Minus 42 l4 Underreport 01 2 3 Disparity ‘as 

P Advising Neutral 248 164 — — 218 163 ar 


a: Significant disparity where no predi 
b insufficient to permit test, 
° Unverified prediction, 


previous statement 


relevance for 
the therapist. 


The coding reliabili 


task or ego-orientation, 
This independent judge agreed in 78%, 83%, 


and 85% of the Tesponses with the judge who 
coded the entire set of interviews, These fig- 
ures far exceed chance expectation, and are 
considered to be sufficient evidence for the reli- 
ability of the task-ego categorization scheme, 


Results 


The results of the study 


bearing on the pre- 
diction of the accuracy 


of the therapists’ re- 


Porting of what transpired in the therapy ses- 
sions are presented in Tables 1 and 2. 
inspection of 


the general substantiation of the hypotheses 


material, and 6 
fication, In additj 


a weakness of the instrument. 
improvement in prediction 
rmit is extremely encouraging: 
e second major portion 0 
ented in Tables 3 and 4- 


—_ a 


Countertransference Effects in Psychotherapy 


The specific prediction that therapist re- 
sponses following patient responses contain- 
ing interpersonal interactions, which had been 
kero judged to be conflictual for the 
; eon would tend to be ego- rather than 
ask-oriented, finds strong support in the data. 


Discussion 


p De very least, we may conclude that the 
a formulations concerning the manifes- 
phe s and effects of _countertransference are 
then antiated. In addition, it is clear that the 
iat apist s reports of his own and his patients’ 
ese in therapy are not to be trusted as 
ee In 25 out of 27 cases of overreport- 
oth ere was distortion not only on the basis 
a e comparisons with the neutral traits, but 
‘SO on an absolute basis. That is, the thera- 
i reported more of the behavior than actu- 
g occire, Varying levels of experience 
erapy and of increased self-awareness 
auent about by personal analysis do not 
a: to make a difference. We may also con- 
yaad with somewhat less confidence, that the 
aS ‘apist evaluation device provides us with a 
ae of predicting those areas in which dis- 
the aons will occur, and in the case of the 
th tapist’s self-reports, the direction that 
ese distortions will take. 
it is unfortunate that these personality 
i Tiables are not more readily translatable 
nto terms which can be applied to psycho- 
analytic theory. It is possible that there is a 
relationship between certain tendencies to 
AT or underemphasize a behavior trait in 
fe ne self or in others, and the classical de- 
lit se mechanisms described in psychoanalytic 
erature. The tendency of Therapist 1 to 
weet his own problem areas into his pa- 
; nts’ behavior seems quite clear. Tendencies 
© underestimate the frequency of appearance 


Table 3 
Therapist 1 
Category Conflict Nonconflict Total 
Task 159 202 361 
Ego 71 52 123 
230 254 484 


AA eNA a AT a l 
N y 
ote.—Chi square 6.29; p < .02; df 1. 
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Table 4 
Therapist 2 
Category Conflict Nonconflict Total 
Task 58 115 173 
Ego 185 76 261 
243 191 434 


Note.—Chi square 59.5; p < .001; df 1. 


of certain traits in one’s self may parallel the 
mechanisms of denial and repression, and to 
overestimate them, the mechanisms of intel- 
lectualization or isolation. It must be admitted 
that the data of the present study are insuffi- 
cient to allow a definitive statement about this 
issue. The problem of relating overt behavior 
types to the theory of defense mechanisms is 
one which requires further investigation. The 
methodology of this study seems to offer a 
promising means for such an investigation. 

It seems clear that the appearance in the 
patient of behavior which is conflict relevant 
for the therapist prevents the therapist from 
functioning at maximum efficiency. In addi- 
tion, there seems to be a definite relationship 
between the amount of experience and/or 
self-insight which the therapist has, and his 
tendency to show task-oriented, rather than 
ego-oriented behavior. It appears that even 
though both therapists’ perception of their 
patients is disturbed by their own conflicts, 
Therapist 1 is able to make use of his ex- 
perience to behave in a more appropriate and 
effective manner in the actual process of psy- 
chotherapy- Apparently, training and super- 
vision do pay dividends in terms of increas- 
ing the benefits of psychotherapy to the pa- 
tient, if the proportion of task vs. ego-oriented 
statements by the therapist is accepted as a 
rough criterion of therapeutic effectiveness. 

In addition to the relevance which this 
study has for the selection and assignment 
of patients to therapists whose personalities 
would be least limiting in the relationship 
with a given patient, and the importance 
which it has in regard to the confirmation of 
analytic formulations concerning the mani- 
festations, sources, and effects of counter- 
transference, the possibility of further investi- 
gation of psychoanalytic theory through a re- 


356 


formulation in terms of concepts from general 
psychology should not be overlooked. Such at- 
tempts to reconcile evidence from two fairly 
separate spheres of psychology may permit 
us to move more rapidly toward a truly gen- 
eral theory of behavior. 


Summary 


patients’ behavior in Psychotherapy, and upon 
his effectiveness in dealing with Patient ma- 


postulated a systematic relationship between 
the therapist’s conflicts, and his tendency to 


which was Conflict-relevant for hi 
less adequate than his handling 
which was relatively conflict-free, 

herapist conflict areas wer 


sumed to represent 
what had transpire 
standard against which to compare the thera- 


pist’s reports. In addition, each therapist re- 
sponse was coded 


ego-oriented, and the latter y 


represent a less adequate handling of the pa- 
tient than the former, 


Of @ total of 40 predictions made regard- 


Richard L. Cutler 


ing the therapist’s tendency to distort E 
reports of need-relevant behavior, 28 y i 
clearly confirmed, 2 found partial ne 
could not be tested because of an insufficien 
number of occurrences of the cee 
question, and 6 were not supported. In a a 
tion, there was a significant pie, ote og a 
tween the appearance, in the patient’s S E 
ment, of material which impinged IRAR ad 
conflict areas of the patient and the ju S 
inadequacy of the therapist’s immediately 
following res onse. 

The fesili were interpreted to offer a 
Support, both for the validity of the Freu i 
formulations concerning the effect of one 
transference and for the adequacy of A 
translation of these formulations into Bruner 
terms. A 

The feasibility of the objective study o 
therapeutic relationship was pointed out, eH 
the potential fruitfulness, for future researc ‘ 
of additional translations of Freudian co? 
cepts into the terms of general psychology 
was indicated, 
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Social Desirability and Self-Ratings of Intakes, 
Patients in Treatment, and Controls’ 


H. J. Wahler 
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A number of recent studies (1, 2, 3, 7, 11) 
il consistently demonstrated a strong rela- 
a Aslen iseli -desogphonS and rated so- 

esirability of personality items. Com- 
els correlations have been obtained with 
Gen a item content, scaled and nonscaled 
ùi ial desirability weights, and various tech- 
a es such as true-false questionnaires, self- 
eens and Q sorts. The stability of certain 
ai desirability stereotypes and their rela- 
edu independence of such variables as age, 
fy cation, sex, socioeconomic status, and cul- 
Ge differences have been shown by Klett 

: 9) and others (1). 

a of the findings cited, involving self de- 
iptions, were based on the responses of stu- 
ent samples. These studies show that a high 
ee of correspondence between averaged 
descriptions and item desirability is a 
Seneral response characteristic of such groups. 
Sr (11) obtained results identical to those 
-n dwards (1) with his student grons. How- 
ee he found that when the self appraisals 
see were correlated with social de- 
" ability, the obtained coefficients ranged 
om negative to positive values, with a pre- 
ae anee on the positive side. These results 
ti icate that not all people give self descrip- 
ons which agree positively with item desir- 
ability. 
To account for the relationship which he 


T The author wishes to extend his appreciation to 
saie liament and Harold Bechtoldt for their kind 
Te in obtaining student ratings and to Lynn 
heir s, Margaret Walsh and Marvin Graber for 
ETE r A help in rating patients and scheduling 
to Ro S for testing. The author is also very grateful 

wena Rash for her painstaking assistance with 


° major porti i f 
i on of tations necessary for 
his study. the computa 


found, Edwards suggested two hypotheses. 
One was that people either consciously or un- 
consciously tend to describe their personality 
traits in such a way as to “look good.” They 
may accomplish this by indicating that so- 
cially desirable items are characteristic of 
them and that undesirable items are not, re- 
gardless of the validity of such assertions. 
The second assumption was that personality 
traits judged desirable are in actuality more 
typical of members of a culture than are un- 
desirable traits, and this is reflected in the av- 
eraged self-descriptions of nondeviant groups. 
Considering only the correspondence of sub- 
jects’ (Ss’) traits (which could be defined op- 
erationally in terms of specified personality 
assessment procedures) and self-descriptions 
with social desirability, Edwards’ hypotheses 
imply two general types of respondents: (a) 
Ss whose traits (actually a selected sample) 
are not in agreement with social values but 
whose self-appraisals correspond with item 
desirability and (b) Ss whose traits corre- 
spond with social desirability and whose self- 
descriptions reflect this. Rosen’s findings pro- 
vide a basis for assuming two additional types 
of respondents: (c) Ss whose personality 
traits do not correspond with social values 
and whose self-descriptions reflect this, and 
the logical possibility of (d) Ss whose person- 
ality traits correspond with social values but 
whose self-descriptions are not positively re- 
lated to item desirability * (malingerers?). 
2While these four suggested classifications are ex- 
pressed in categorical terms to facilitate exposition, 
it is more realistic to assume that all of the factors 
are a matter of degree, i.e., personality traits of indi- 
viduals are more or less in agreement with social 


values as are the self-appraisals of groups or indi- 
viduals. 
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Since self-descriptive techniques are widely 
used in clinical practice, it is important to in- 
vestigate the degree of correspondence be- 
tween the self-appraisals of clinical Ss and 
item desirability. Edwards and others have 
shown that if the social desirability weights 
of a set of personality items are known, ap- 
proximately 75% of the variance in self-ap- 


is, the clinical use- 


to even more serious conjecture than is cur- 
rently the case (4, 5, 6). 

With clinical Ss, particularly those who are 
receiving Psychotherapy, operationally defined 


contains numerous 
various traits judged 
atients, Many of these 


marily to social desirability stere: 
could readily be interpreted as d 


appraisals corre- 
sponding with item desirability, 


factors in con- 


H. J. Wahler 


self-descriptive characteristics of such peor 
It is widely held by many c inican a 
among other effects, Psychotherapy ten me, 
reduce defensiveness and/or increase in s 
or realistic self-awareness. If therapy ma 
effect, the self-descriptions of people Eo a 
therapy (patients) should be less ae y 
lated to item desirability (and more stro. a 
related to therapists’ estimates of their a ind 
than would be the case with people sa 3 
such assistance for the first time (inta A 
This, of course, would not hold if the iA 
descriptions of intakes were in no way in a 
tive of defensiveness, Considering the ieee 
emphasis in the literature on the observe s 
fensiveness of people undertaking therapi 
particularly at the outset, it seems probe 
that their self-descriptions may also re 

this tendency, i on 

While this investigation js primarily c 

cerned with 
desirability 
Ss and therapists’ appraisals 


between self-des, 
ous groups and 
tive estimates 

group. In this ¢ 
of the Self-descrj 


rapists’ appraisals. On P 
e self-descriptions of aona 3 
© expected to correspond 
ged traits of clinical aa 
this study is to compare d 
ndence between peli rataa 
and in pendently Obtained social desirabili 4 
Of personality items foun 


Other h: 


Social Desirability and Self-Ratings 


with intakes, patients, and student and non- 
student control groups. A second purpose is 
to compare the coefficients obtained by corre- 
lating averaged therapists’ ratings of a group 
of patients with the self-ratings obtained from 
a above groups. The above groups will also 
e compared with regard to the relative levels 
at Which they ascribe clinically meaningful 
traits to themselves which are classified as un- 
desirable, slightly undesirable, and desirable. 
_Klett’s (9) findings with groups of Aos- 
Pitalized psychotics suggest that there may 
ere systematic differences in judged s0- 
si desirability between clinical and nonclini- 
ec Since differences in conceptions of 
3 ial values could affect self-descriptions, the 
fot among social desirability ratings 
tees from students and intake and pa- 
samples from an outpatient clinic will 

e determined. 


f Procedure 
Subjects 


Bevo different groups of male clinical Ss 
io used. The patient group consisted of 42 
€rans receiving psychotherapy at an out- 
Aetent mental hygiene clinic. Only patients 
or o Fere not judged to be grossly disturbed 
" Psychotic were asked to participate. These 
People had received an average of 84.83 one- 
is ur individual interviews; the number of in- 
Q ‘views ranged from 12 to 392. Patients gave 
Ocial desirability and self-ratings in counter- 
alanced order, The intake group was com- 
Based of 25 veterans in the process of apply- 
Ng for treatment at the same clinic. All of 
at: Se Ss gave self-ratings; 6 were randomly 

€cted to give social desirability ratings. 
Four different student groups gave social 
esirability ratings. They were comprised of 
ate and 29 female students in intro- 
vA ory psychology classes at the State Uni- 
tsity of Iowa (SUI) and 6 male and 27 
oe students attending a night course 1m 
S oe psychology at Drake University. 
elf-ratings were obtained from a group of 27 
cej, male students and 30 male veterans re- 
"Ving outpatient medical treatment for non- 
chiatric conditions at a Veterans Adminis- 
Wa lon outpatient center. The veteran group 
ord carefully screened to exclude Ss with rec- 
S of neurological or psychiatric diagnoses 
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or complaints. None of the Ss were older than 
55 or younger than 18. , 


Self-rating Inventory 


The inventory used to obtain self-ratings 
and social desirability ratings consisted of 44 
items pertaining to characteristics commonly 
regarded as important clinical variables such 
as anxiety, hostility, sexual difficulties, de- 
pendency, suspiciousness, poor interpersonal 
relations, etc. All self-ratings were obtained 
with a 9-point scale. The extremes were an- 
chored “not at all like me” and “beyond ques- 
tion very much like me.” Social desirability 
ratings were also obtained with a 9-point 
scale. Extremes were anchored “definitely very 
highly socially acceptable” and “definitely 
very highly socially unacceptable.” All Ss 
were oriented to estimate how desirable the 
various traits would be in general to other 
people: Rosen’s (11) “perceived social desir- 


ability.” 
Therapists’ Ratings of Patients in Treatment 


The 42 patients in treatment were being 
seen by four therapists during the time data 
was collected; 14, 11, 9, and 8 patients, re- 
spectively, were in treatment with different 
therapists. Therapists rated all patients who 
were serving as Ss on the items of the self- 
rating inventory. The same nine-point scale 
was used except that the pronoun “him” was 
substituted for “me” in all anchoring phrases. 
Therapists also rated the items for social de- 
sirability. ` 

Results 


Social desirability ratings of the student 
groups were pooled since all intercorrelations 
were high (7 = .922) and there were no sig- 
nificant group differences. 

The correlational matrix was computed for 
the averaged social desirability ratings of the 
combined student group (N = 124), intakes, 
patients, and therapists; the average 7 was 
920. A test of over-all homogeneity was non- 
significant; ° none of the group means differed 
significantly. These analyses indicate that the 
social desirability ratings obtained from stu- 

$ The results of any statistical test will be termed 


significant if the corresponding p value is .05 or less 
and nonsignificant if p is greater than .05. 


Table 1 


Correlations of Self-Ratings with Social Desirability Ratings for Controls, Intakes, 
Patients, and Therapists’ Ratings of Patients 


H. J. Wahler 


Self-ratings 


Therapists’ 


SUI Outpatient PEIN pn 
Social desirability Males veterans Intakes atients ate 
i ratings (V=30) (N=27) (N=25) (N=42) (N=4) 
Students (N = 124) .755* .753 .661 373 a. 
Patients (V = 42) .678 696 .620 .337 Ew 
Intakes (N = 6) .708 -123 .526 .242 me 
Therapists (V = 4) 648 693 521 211 =a 


* Coefficients based on averaged ratings of 44 items; rz = .385 significant at .01 level; z = .2 


dents, intakes, patients, and therapists are 
highly comparable. 

The averaged Self-ratings obtained from 
outpatient veterans, SUI students, treatment 
and intake patients, 
of patients were correlated with mean social 
desirability ratings 
groups. These coeffi 
Table 1. None of the 
column differ signific: 
in the first row of 

Correlations bet 
ability and self- 


ratings of intakes 
Therapists’ ratings 
Table 2 


Intercorrelations Among Mean Self-Ratings of Controls 
Intakes, Patients, and Therapists? á 


Ratings of Patients 
Thera- 
pists’ 
SUI ratings of 
Males Intakes Patients patients 
Outpatient 
veterans  .817* 710 425 085 
SUI Males 687 514 154 
Rabies 811 422 
Patients 724 


* Coefficients based on averaged ratings of 44 items; y = 385 
significant at .01 level; r = .298 significant at .05 level, 


98 significant at .05 level. 


of patients were not significantly related t0 
social desirability. ene 

While the correlation between self-descripi 
tions and item desirability was slightly low 
for intakes than for controls, the difference E 
short of significance. The correlation herve 
self-descriptions and item desirability for pa 
tients is considerably less than for intake 
and the two control groups. Ja- 

Table 2 contains the matrix of intercorre E 
tions among the averaged self-ratings of OU 3 
patient veterans, SUI students, patients, ma 
takes, and therapists’ ratings of patients. T 3 
test of homogeneity of y's was highly sigh) 72 
cant. Self-ratings of patients and intakes a: 
relate significantly with therapists’ ratings a 
Patients; the self-ratings of both corna 
groups are not significantly related to a 
values. Self-ratings of patients correlate ae 
nificantly higher with therapists’ ratings tha 
do those of intake + or control groups. 


; It 
is annttapists rated the 42 patients in treatment. 1 


ite wala 
S assumed that idiosyncratic differences among 1 
vidual patien 


that these 


an entirely satisfactory compar 
ad more opportunity for ob akes 

bport to the finding that intate” 

not correspond as highly with 


servers’ ratings as do those of patients. 


25. > > - 
SEE: C—O 
— Te a 
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Sens of intakes correlate significantly 
a er with therapists’ ratings than do those 
Ke patant veterans but not SUI students. 
E also be noted that self-ratings of the 
ey = patient groups correlate -311 with 
z other. Self-ratings of the two control 
BEOUpS correlate at about the same level (r 
TA The self-ratings of intakes or pa- 
eee to a lesser degree with the 
r ings of either control group; these 7’s 
ange from .425 to .710. 
Aes average levels at which the various 
Pomp rated themselves were compared. To 
poem these comparisons, the 44 items were 
aia as undesirable, slightly undesir- 
me and desirable.® The mean level of the 
Shia on items in these three categories was 
of ined for each S and for therapists’ ratings 
oh parent. Analysis of variance (10) based 
eea scores yielded highly significant ef- 
actio or groups,” social desirability, and inter- 
E The mean ratings of the four groups on 
ake s in the three social desirability categories 
presented in Table 3. 
ep of the significance of differences be- 
si ee mean self-ratings of the different groups 
elie in each category were made. The results 
cad that patients rate items classified as un- 
ansabe and slightly undesirable at a sig- 
fea y higher level than intakes. It was also 
a n that both clinical groups tend to rate 
si esirable and slightly undesirable items at 
oy higher levels than controls. In- 
at es and patients also rate desirable items at 
ET level than controls; however, this dif- 
ae is not significant. The best discrimina- 
i n between controls and intakes or patients 
S obtained with ratings in the slightly unde- 


5 
ag ee classifications were based on the pooled s0- 
desirability ratings of students (N = 124). Arbi- 
our lues less than four, 
fine S five, and greater than five were used to de- 
and he categories undesirable, slightly undesirable, 
desirable. The number of items in each classifi- 


outpatient 
analy- 


Vete; r 
ran group was selected since it 1S more com- 
s in terms of age, 


Par: 

= to the veteran clinic groups 1}... i 

es ation, socioeconomic level, and military exper 
e than the students. 


Table 3 


Mean Self-Ratings on Items Classified as Undesirable, 
Slightly Undesirable, and Desirable for Controls, 
Intakes, Patients, and Therapists’ 

Ratings of Patients 


Thera- 
pists’ Out- 
Typeof ratings of patient 
item patients Patients Intakes veterans 
Undesirable 
(16 Items) 4.90 4.31 3.70 2.91 
Slightly 
undesirable 


(20 Items) 6.05 5.77 5.14 3.88 


Desirable 
(8 Items) 4.73 5.40 5.58 5.27 


sirable category. Ratings in this category Cor- 
rectly identified 78% of intake and control Ss 
and 85% of patients and controls. 


Discussion and Conclusions 


The findings show that the self-ratings of 
intakes correlate with item desirability to 
about the same degree as the self-ratings of 
student and nonstudent controls. The self- 
descriptions of patients show only slight cor- 
respondence with cultural desirability stereo- 
types. 

In the case of intakes, however, and to a 
much greater extent with patients, ‘ there is 
evidence that their self-descriptions are to 
some degree “valid.” It was shown that in- 
takes do attribute clinically meaningful char- 
acteristics to themselves to a greater extent 
than controls. Their self-descriptions corre- 
lated significantly with therapists’ ratings 
while the ratings of nonclinical Ss did not; 
their self-ratings correlated significantly more 
highly with those of patients in treatment 
than did ratings of controls; and intakes rated 
themselves at significantly higher levels than 
controls on items classified as undesirable and 
slightly undesirable. To this extent, their self- 
descriptions appear to contain “valid” vari- 
ance. With patients, the evidence is much 
more strongly in this direction. 

These findings, plus the fact that therapists’ 
ratings of patients’ traits did not correlate 


with social desirability, indicate that patients 
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may be readily classified as Ss whose person- 
ality traits do not correspond with social 
values and whose self-descriptions reflect this. 
It is apparent that the self-descriptions of pa- 
tients cannot be as readily predicted from 
item desirability weights as appears to be the 
‘case with nonclinical Ss. If certain traits of in- 
takes, as a group, are comparable to those of 
patients, and hence do not correspond with 
social values, intakes would be classified as Ss 
whose traits do not agree with social values 
but whose self-descriptions correspond with 
item desirability. Nevertheless, the self-descrip- 
tions of intakes can be teliably discriminated 
from those of nonclinical Ss, since intakes rate 
undesirable and slightly undesirable traits at 
a significantly higher level than 
the self-ratings of intakes correlate signifi- 


tients ascribe undesirable characteristics to 
themselves is also in accord with this view. 
Among both intake (e 


marked tendency to 
which correspond primarily to cultura] stereo- 
types of desirability, and to deny clinically 
meaningful traits judged undesirable among 


7 While not high, the linear correlation was 39 
( < .025); eta was .66, but the deviation from 
linearity was not significant. If Ss who had received 
no therapy had been included, these coefficients would 
have been larger. 
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people sufficiently maladjusted to seek or par- 
ticipate in therapeutic assistance, suggests 
considerable defensiveness and/or lack of in- 
sight on their part. At least the probability is 
high that they are failing to provide person- 
ally relevant communication. ’ 

The extent to which such noncommunicative 
tendencies are related to various prognostic 
criteria has not been explicated. Questions 
may be raised, such as, do people seeking help 
with personal problems who are noncom- 
municative at the outset constitute poor thera- 
peutic risks? Are they more likely to terminate 
therapy Prematurely or fail to show signs of 
Profiting from continued therapy than persons 
who are initially more communicative? The 
study of Rubinstein and Lorr (12) suggests 
that some factor such as noncommunicative- 
ness may be related to premature termination. 
These authors found that “. . . [remainers] 
are more dissatisfied with themselves, feel 
Worse, and see themselves as having poorer 
interpersonal and overall adjustment than 
terminators,” 

Since it was shown that patients receiving 
therapy were typically more inclined to ascribe 
undesirable and slightly undesirable traits to 
themselves than were intakes, the question 
may also be raised as to whether prognosis 18 
more unfavorable for those patients who fai 
to show an increase in personally relevant 


communication after a Certain number of in- 
terviews. 


The evidenc 
Preliminary, 
level at which 
selves on clini 
in terms of 


Summary 

Ete of this study was to compng 

a e ationships bet j cial de- 
sirability and ween judged so 


e self-ratings obtained from pa- 
tients in treatmen 7 


z t at an outpatient clinic, 
intakes, and stude p 


nt and nonstudent control 


l 
| 
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groups. Another purpose was to correlate the 
self-descriptions of these various groups with 
therapists’ ratings of patients. 

The findings showed that the self-ratings 
of intakes correlated with social desirability 
weights to about the same degree as the self- 
ratings of controls. The correlation between 
the self-ratings and item desirability obtained 
with patients was significantly lower than the 
correlations obtained with intakes or controls. 

Self-descriptions of both clinical groups Cor- 
related significantly with therapists’ ratings of 
Patients, while the self-ratings of the two con- 
trol groups did not. 

4 ih items classified as undesirable, slightly 
ndesirable, and desirable, it was shown that 
p ents rated themselves significantly higher 
han intakes, and intakes rated themselves sig- 
nificantly higher than controls on undesirable 
te slightly undesirable items. Items in the 
X ightly undesirable classification gave the best 
iscrimination between clinical groups and 
controls, 
it The possibility of using scores based on 
ems classified as undesirable and slightly un- 
oe as indices of personal communica- 
š eness was discussed. It was suggested that 
uch scores deserve further study as predictive 
and evaluative measures with regard to 
therapy, 
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A Technique for Investigating the Relationship 
Between the Behavior Cues of the Examiner 
and the Verbal Behavior of the Patient” ’ 


Leonard Krasner 
Veterans Administration Hospital, Palo Alto, California 


In a previous paper, the writer suggested 
that techniques of conditioning verbal behay- 
ior be used in a program of systematic in- 
vestigation into the 
and offered a rationale for such a procedure 
(2). It was proposed that such a program 
be initiated by studying the relationship be- 
tween behavioral cues indicating “attention” 


A technique was devised to cre 
personal situation which would have as many 


f the s of the Psychotherapeutic 
situation as possible, Further Consideration 


ate an inter- 


would result in specifi 
ject’s verbal behavior. 


Method 


Subjects. Two male, white, veterans, 30 
years of age, with high school education, and 
diagnosed as schizophrenic reactions in re- 
mission, were asked to participate in a study 
to determine how people “tell storjes.” 


1 From the Veterans Administration Hospital, Palo 
Alto, California. Research was conducted at the Vet- 
erans Administration Hospital, Lexington, Kentucky, 

2 A paper based on this study was Presented at the 
1957 American Psychological Association meetings, 


Procedure. The equipment consisted of 2 
standard timer, placed on the desk so tha 
both $ and E could see it, and a tape rê- 
Corder. Prior to the first session, S was give? 
the following instructions: “I want you to 
make up a story with at least four characters 
in it, a mother, a father, a child, and an = 
mal. It can be any kind of a story. I s 
you to tell me the story for ten minutes. I 
start the timer now, and it will ring when tae 
ten minutes haye Passed. All right, go ahead. 
Prior to each of the following 24 sessions, 
the same instructions were repeated with onè 
change. Instead of “PI start the timer now, 
and it will ting when ten minutes have 
Passed,” Æ said, “You can either continue 
your story from the last session or start 4 
new one.” 

Each § Participated in 25 ten-minute ses 
sions, which were divided into five blocks of 
five sessions each, During the first block of 


Sessions (nonreinforcement): 


With a Combination of behari 
time the $ made reference T 
rbal behavior “mother.” £ 


Was defined as “all noui 
erring to the mother figur! 
1n the S’s stor A 


OO E E a 
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Table 1 


Number of “Mother,” “Father,” and Total “References” (Nouns and Pronouns), and Percentages of 
“Mother” to “Mother and Father” and to Total “References” for Successive 
Blocks of Five Ten-Minute Sessions 


Per cent references 


ee ee 


j “Mother”/ 
ae and Number references “Mother” 
eager and “Mother”/ 
FRONS Condition “Mother” “Father” Total “Father” Total 
Subject I 
1-5 nonreinf. 161 201 1306 45 2 
G10 reinf. 272 138 1315 66 21 
1-15 nonreinf. 255 235 1212 52 3i 
16-20 ini: 313 245 1222 56 26 
21-25 nonreinf. 190 227 1197 46 16 
Subject IT 
t5 nonreinf. 68 48 384 59 18 
6-10 reinf. 90 51 319 64 28 
1-15 nonreinf. 18 109 261 14 7 
16-20 reinf. 129 114 519 53 25 
21-25 onsi: 100 153 552 40 18 


Br ponreinforcement condition, as in the first 
fourt} of five sessions, was repeated. The 
inf h block of five sessions repeated the re- 
orcement condition of the second block of 
ve sessions. 
pen completion of the 25th session, the 
of Were interviewed to determine their degree 
awareness of the conditioning procedure. 
— interview consisted of 2 dozen questions 
as, “What do you think was the pur- 
Don of these sessions,” “Did you notice any 
anges in the stories as you went on,” “Do 
flue think that my sitting here in any way in- 
uenced your stories?” 


Results 


The total number of “references” made by 
each of the major characters in the stories 
— mother,” “father,” “child,” and “animal 
were summarized for each individual ses- 
i i be be scored as a “reference,” the ver- 
f ization had to be a noun or pronoun Te- 
erring to one of the four major characters. 
= ratios of “mother references” to “mother— 
er references” and to total «references 
Were computed for each of the 25 sessions. 
eae two ratios were divided into those 
alizations emitted under reinforcement 


conditions and those verbalizations emitted 
under nonreinforcement conditions. The 
Mann-Whitney U test (5, pP- 116-126) for 
the significance of differences of “references” 
under the conditions of reinforcement and 
nonreinforcement for these two ratios was 
computed for poth subjects. All four of the 
ratios were in the predicted direction, and 
three of the four, both ratios of Sx, and the 
“Mother” /total ratio for Sr, were significant 
beyond the .05 level. 

An examination of these two sets of ratios 
for successive blocks of five sessions indicates 
that the ratios of the reinforced class of be- 
havior increased under reinforcement condi- 
tions and decreased under nonreinforcement, 
increased again during the succeeding rein- 
forcement series, and decreased again during 
the final block of nonreinforcement sessions. 
These systematic variations were also true of 
the absolute number of “references” as well 
as the percentages. Table 1 presents both per- 
centages and numbers of “references” for suc- 
cessive blocks of five 10-minute sessions. 


Discussion 


This technique of verbal conditioning en- 
ables the testing of hypotheses concerning 
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what happens to various classes of verbal be- 
havior under selected experimental conditions, 
The hypothesis in the Present study that the 
reinforced class of verbalization varies sys- 
tematically with the application of E’s be- 
havior cues was confirmed with two patients, 
It is of interest to note what happened to the 
other categories of verbal behavior which ap- 
peared in the stories, i.e., “father,” “child,” 
“animal.” All three of these Categories varied 


sharply from session to session, but in no sys- 
tematic manner. 


ing” studies 
with their implications for Psychothera; 


lic py (3), 
the writer divided techniques of con- 
ditioning verbal behavior into four general 


tions: saying 
completing sentences; “story- 


to the techniques rep 


orted in studies by Ball 
(1) and Mock (4). 


Leonard Krasner 


cues and patient’s verbal behavior. The re- 
Sults indicate that changes in a preselected 
class of verbal behavior varied-as a function 
of the systematic application of behavior cues 
by the examiner. It is concluded that this 
experimental procedure permits the system- 
atic isolation and study of important variables 
of the interpersonal process basic to psycho- 
therapy. 
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Rong of the fundamental cleavages in intelli- 
ing b as it is commonly tested is that obtain- 
ee the ability to manipulate verbal 
with pts effectively and the ability to reason 
ties hes and efficiency in terms of quanti- 
is 766 a H road dichotomy of general aptitude 
amin ognized by the College Entrance Ex- 
fe (aa Board in its Scholastic Aptitude 
the 4 AT) which is comprised of two tests, 
Smits Aptitude Test (MAT) and 
man verbal Aptitude Test (VAT). In like 
s Ta the American Council on Education 
eae. ological Examination in its decades of 
in ence had its separate quantitative an 
eae scores. The Army General Classifi- 
“ng Test of World War II sampled these 
two abilities, linguistic and quantita- 
Was. R third ability measured by the AGCT 
fore a spatial factor. It would appear, there- 
Strug that both theory and practice in the con- 
pl ction of measures of general aptitude have 
Hore the stamp of approval on the func- 
of pal independence of these two Jarge sectors 
eee s intellectual abilities, 1¢» dealing et 
on ively and precisely with quantities on the 
eed and with the less precise, often af- 
tively toned verbal constructs OP the other. 
ae would seem plausible to expect that in- 
Hae variability along such culturally sig- 
De ag continua as quantitative and linguistic 
bilities might be reflected in one’s style of 
ìving and in his various attitudinal frames. 
as L. Wells (6), for instance, feels that ae 
la of intelligence are significantly relate 
i Personality attributes. His basic contention 
P rara to be that a deficiency in quantitative 
i ility, say, is a function of 4 basic attitude: 
es individual’s being repelled by the rigidity 
nd precision of a numerical quantity, being 
attracted by the adumbrative and connotative 
nuances of the adjective and the verbal tag- 


The verbalist p 


ch a 
“That day we ti pi 


» a long 
tance,” to the r osaic and exact, =" 
spent ten hours 744.2 miles that day". 
To the verbalis’ (atter statement limits 
and confines, le: | to the imagina- wut 


tion, is obtrusiv | it 


Sy 
tetic’ ant, lente le t 
tistics; he even pfa nigel work ou 


his traveling scl {ea S| ad, since 
the thicket of m False | amyl Pes tine Le 
table was appa! Peng ay to 
handle. Jones : True (2) y ement of {e 
Freud’s concerni q sJinguistic y 


s 
“J have very res di De talents. . 
None at all for talse |) “teg ; nothing 
for mathematics; 6%, “thing quanti- 
tative.” Oy, | 
Wells appears Tru? gat what he calls 
5 . Fall Caan č H 
veal is no 47N entity fan ental 
characteristic rat** (a ie 1 one 
In terms of gene pat intellect e 
rbalist and the ustment, me ien r- 
ve True) atively oriented pe 


a1 - 
S e Sp g 5 
dichotomy whick false i he psi 


son should be rfalse zh the 
verbalist may be | coequal, an a 
with the norms 0 j hat nei B 
ward precision a: J pres z 3 F 


speaking and wri 
completely of a 
effect that the C a geet 
vidual is more s,-thantivey eee the ver- 
palist tends to Sgo piget w 
tions. “This,” W, than Y m aia 12), 
“ties in with they, thentinues ie 
served generally itne MÌ social te? 
as well as the SPegfferere!P? ing’ ir 
this particular Mar the è for 
In 1946, Munroe (res 
ul 
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368 se certain differ- 


mo Rorschach be- 
nirence who were 

‘aneasured by the 
tween students | a) in comparison 
quantitatively c yiwent in the op- 
Qand L fractid ad Ci conclusions re- 
with those who: hces found were 
posite direction. ‘{relatively literal 
lating to the sf ¢, while the high 
that the high Qege  bective approach, 
in their construt 


z | male executives, 
L women use „refers Pificant relations 
Pemberton (4) veled ils on the ACE 
was able Si a re pluder Preference, 
ae dota ai gome, pea ion 
an ord-Martin In- 
t F 
Allport-Vernon à zon example, the 
Temperament * gma above their 
ventory of Fact® igher scores on 


we tone’s Refl 
whose L st my z tursi one 8 etlec- 
men > dis Fn Social. 


es had ? Jjed- 
© en: Liter} Altus (1) found 
veen Q—L differ- 


ive factor, the f 
tive d i ;swers of 200 col- 


In a previous) | : 

ignificant “(ue w/Multi hasic Per- 
some sig ni p p 
entials on the A a70 exl, he found that 
lege women to th | zoman was prim, 
sonality Inventar ious, and some- 
the Q-higher-ti with the college 
conventional, ! not. 7 to go in the op- 
what resentful ^ A scale of 43 


poe | to, feMMPI which an 
pore Ea nore an, of .25, which is 
ee validatic insteae .01 level, since 
an fies of gher thae recently, Spilka 
the N involve;”al adj Altus’ 43 MMPI 
and Kimble ( quanti? women students 
items with a oughly und an r of .22 
at Washburn? £°™€“2 ACE, thus con- 


with Q—L ajf CMU the validity of 
firming in a 9d ni Ce pears, therefore, 
the items in t8- 


“ted studies that 
from these į 


statem*ithe quantitative- 
a z 

variation in im ü 

verbalist con? jı 


fatt S ™® Certain per- 
e specified in 
sonality facek SeS, Pecifie 
crude degree) ells 


esting findings | 
ences she found 


n 

p » at least. 

a the 

izjal ne? been previously 

Since college” d to confine the 
investigated, it Y 


iL 
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Present research to college men, using the 
same psychometric variables, i.e., the MMPI 
and the differentials in Q and L on the ACE. 
Two hypotheses were set up: (a) that the 
Q-higher-than-L college male would be more 
masculine (have a lower Mf score on the 
MMPI) than the L-higher-than-Q college 
male; (b) that the L-higher-than-Q men 
should appear somewhat more sophisticated 
and mature on certain of their answers. The 
reasoning behind the hypothesis of greater 
masculinity of the high Q males is that men, 
Senerally, tend to do better on Q tests E 
do women; hence, it would appear that ee, 
who excel other men in this sex-biassed i: 
able should show more of those attitudes a 
turally associated with masculinity. The ba a 
for the second hypothesis is derived from a 
findings on college women: the more vel 
women were more mature and sophisticate 
in the answers which discriminated them from 
the higher Q women on the MMPI. 

The raw ACE Q and L scores for 200 col- 
lege males Were converted into standard units 
with means of 59 and sigmas of 10. TWO 
STOUPs of 100 with comparable Q and L scores 
were formed, Each of these groups of 100 was 


roken into quartil i the 
K es of 25, the basis for 
Separation being the Sine 


ancy scores b 
All the validati 
MMPI were th 
differences, In 
of the MMPI 


sary because of the 
= individua] T-F items in the MMPI; using 
EA 200 as a single group with four 
°F analysis would inclu- 

by leat i Cause the inc 
minate, number o 
which comprise the MMPI 


Results 
Two of the MMPI 
mean differences bena showed significant 
quartiles when the entire 200 Dpat and lower 
considered as a single group ia. ae 
ranked on 


E 
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Table 1 


The Significance of the Differences Between the Answers of 100 High Q and 100 High L 
College Males to Selected Items of the MMPI 
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G Marking Marking 
P.  Levelof charac- Gp. Levelof charac- 
MMP 
N I confi- teristic of MMPI confi- teristic of 
o. dence Q males MMPI items No. dence Q males MMPI items 
á E -001 False I gossip & little at times. 78 .05 False _I like poetry. 
t 001 True My way of doing things 82 .05 True Tam easily downed in an 
is apt to be misunder- argument. 
stood by others. 325 .05 False The things that 
25 001 Fale  Tliked “Alice in Wonder- ar pee aha 
384 land” by Lewis Carroll. have frightened me. 
001 True I ek oe ns al 404 05 True People have often mis- 
one all abo sent. understood my i i 
50. y intentions 
£ 001 True I do not try to oe when I was trying to put 
my poar aA EA EAE, A Shem right and be help- 
a ul, 
won’t know how I feel. 05 Fals à 
564 001 True Tam apt to pass vP cae os i sit oo aeien Fore 
ing I want to do W en = 
ooo fol that it isn’t 520 05 False Istrongly defend my own 
eth kig opinions as a rule. 
126 OL False I like dramatics. , 95 10 False I go ta gaa almost 
127 OL False Iknow who is responsible every week. 
for most of MY troubles 180 10 True I find it hard to make 
o ol False T like to cook. i talk when I meet new 
% o False I would like to be Jour people. 
nalist. 188 10 False I can read a long while 
237 Ol False My relatives are nearly without tiring my eyes. 
7 3 allin sympathy with me | 255 -10 False Sometimes at elections I 
66 01 True Even when I am with vote for men about whom 
people I feel lonely much I knew very little. 
{ the time. 0 True Iam easily embarrassed 
443 bs to pass up some- 321 A a y rassed. 
01 True ae MeL ie nat to do | 428 10 False I like to read newspaper 
thing 1 that editorials. 
because others feel tha 
! J am not going about it 64 NS False | Isometimes keep on at a 
j wike right way- thing until others lose 
448 o1 True Tam bothered by people their patience with me. 
outside, On street-carsy in 258 NS True I believe there is a God. 
stores, etc- watching are 277 NS False At times I have been so 
45 05 False I do nol lways te entertained by the clev- 
he> 6 truth. wat erness of a crook that I 
9 05 True I am very re a have hoped he would get 
tracted m by with it. 
my own se 
| th n the tend to bear out in a gross way the hypothesis 
e continuum of Q—L discrepancy of 100 that the L-higher-than-Q males tend to be 
h “i For both of the separate gom a with somewhat more sophisticated or less naive 
tha? „the quartile containing a score than the Q-higher-than-L college male. 
ee O-higher-than-L disctePY Toy Lie Also in Wnt ‘vith the original hypotheses, 
! — higher mean values on the he men at the Mf scale of the MMPI showed a highly 
| : ‘ale than did the quartile se Herthi significant mean difference between the high 
fs Sea opposite pole, where the Tr aerenc was and low quartiles of the total group of 200 in 
es were found. The mean nding wou Q—L discrepancy scores. The mean difference 


significant at the .01 level. This 
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is significant at the .001 level of confidence 
(t of 4.30). The college male whose abilities 
are relatively higher in dealing with quantities 
does have more masculine attitudes, insofar as 
these are validly measured by the Mf scale of 
the MMPI. None of the other MMPI scales, 
either clinical or validating, showed any mean 
difference that was significant even at the .05 
level, corroborating once more Wells’ original 
contention and Altus’ and Munroe’s findings 
that the Q—L discrepancies on the ACE are 
not related to general adjustment for college 
women. 

Some 22 MMPI items which differentiate 
from the .05 to the .001 level between the Q- 
versus the L-oriented college man are given in 
Table 1; an additional six which differentiate 


as well as three 


whose nominal significance js less than -10. 


ran to the verbal; į 


Six of the items in Table 1, Nos. 6 

204, and 295, are found on the Mf ef (age 739; 
these items the marking shows 
masculinity and Q-higher-than 
sixth item, “I am very strongly attracte 
bers of my own sex,” the markin, 
direction, that is, 


their own sex. However that may 
poetry, cooking, journalism, 
Carroll's Alice in Wonderland 
cal anti-aesthetic attitude common among the more 
“masculine” males. 
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Three items from the Lie scale show up: 45, 225, 
255. The high Q male is more frequently certain he 
always tells the truth, that he doesn’t gossip, and 
that he knows something about all those men he 
votes for at election time. Naivete and lack of in- 
sight seem to be the plausible explanation rather than 
an attempt at dissimulation, since dissimulation would 
be reflected in attempts to “fake good” on the clini- 
cal scales which patently is not the case. It may, of 
course, actually be true that the high Q man doesn’t 
gossip as often as his verbalist brother; just possibly 
he doesn’t converse as frequently and perhaps he 
isn’t as interested in People—this latter observation, 


it should be noted, would fit in with Wells’ and 
Adler’s contentions 


The attitude of the high Q males toward religious 
Matters (95, 


» 258, 488) is somewhat ambiguous: They 
Pray less frequently than the more verbal college stu- 
dent, and they 80 to church less frequently, Although 
the answer js Not statistically significant, they more 
frequently are sure there is a god (258): Of the 100 
O-higher-than-L men, 88 said Yes to this item, while 
r-than-Q men answered in this 

study (1) of college women, the 
igh Q women were definitely more religiose, but it 
that the evidence for college men 


The dislike for things verbal stands out in several 
of the high Q answers: 78, 126, 188, 204, 295, 428. 
They don’t like Poetry, they don’t like dramatics, 
they “tire” their eyes if they read a lot, they wouldn’t 
Fie be a foumalists ther daat ake eee asian 
they don’t like to read editorials in the newspapers. 

strikingly corroborates the data for col- 
he high Q person simply does not 
Same extent as does the verbalist- 
l however, and which is effect is un- 
clear, even though the facts of the matter are patent. 

erson is not so dominant or sure of 
in matters: 82, 443, 520, 564. He’s 
nt, he passes things up 


j for this reason we should 
that most salesmen and al- 
uld be on the verbalist side. 


nd difficulty in 4 1 rela- 
tions is also evid y in interpersonal 
237, 321, 366 Arie many other answers: 82, 180; 


ple outtalk hi 
sation with 
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Naiveté, dislike of the printed page, diffi- 
ly in social relationships, greater mascu- 
inity (put more exactly, antipathy to the 
aesthetic) —these are the general character- 
istics which the MMPI items show to be true 
to the Q-higher-than-L college male when he 
is compared with his verbalist brother. 


Discussion 


The assumption which underlay the present 
research was that differences in quantitative 
and linguistic abilities among college males, 
as measured on the ACE, should be reflected 
eal frames as measured by the 
hi PI. It was hypothesized that the Q- 
peter -than-L male should tell more “lies” on 
h e MMPI and appear more masculine. Both 

ypotheses were born out at statistically sig- 
nificant levels when the L and Mf scales were 
checked for the two groups of men. 

The individual items of the MMPI which 
differentiated high Q and high L groups cor- 
roborated previous research (1, 4, 5) which 
Pored an antipathy toward reading and simi- 
ar verbal matters and occupations for the 
quantitatively oriented person. Both male and 
female high Q scorers also appear to be less 
Orward, aggressive, and sure of themselves 0 


Social relationships than the student with more 


verbalist propensities. The data lend some 
Plausibility toa hypothesis that social domi- 
nance and leadership may show more than 
a chance linkage to L-higher-than-O Bic ba 
abilities. It would appear that the politician, 
who lives primarily in a welter of words, 
nee be a verbalist far more 
t e 50/50 probability of the | 
ee up heads. These tentative hypott 
end a bit of piquancy when one spe ż 
about Freud and his marked deficie 


matters quantitative. Had he been more adept 
at manipulating numbers, perhaps he would 
have remained in laboratory research; had 
this obtained, there would have been no pri- 
vate practice of medicine, no neurotics, no 
dream theories, no psychoanalysis. But this 
is pure speculation, interesting perhaps but in 


the view of 


appea' 


history completely idle. 


The contention of Wells (6) and Munroe 


(3) that general 
variation in quantitative and verbal abilities 


adjustment is not related to 


rs to be corroborated by the present 


study and by the one which preceded it (1). 


In summary, the 
verbal tends to 
insightful, socially dominant, literary, and less 


orthodox in 


one whose gifts are primarily 
be more sophisticated, self- 


religious matters; at least that 


is the way college students of both sexes tend 


to evaluate th 


emselves on the MMPI and, to 


the extent that their answers are truthful and 
valid, it should show in actual behavior out- 


side the narrow limits 0: 
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Some Scale and Test Correlates of 
a Personality Rigidity Scale? 


John M. Rehfisch 


Sonoma State Hospital, Eldridge, California 


This is a report of the Correlations between 


thought and speech, curious, clear-thinking, 
a true-false invento 


ry scale for Personality assertive, and self-indulgent. 

he present study was designed to further 
Paper (5) explicate Ri by defining its linear relations to 
ion of Ri, other Psychological scales and tests, 

Briefly, the scale Was Constructed by selecting 


Procedures and Results 
samples of rigid and flexible subjects. The 


Correlation Coefficients were computed be- 
tween Ri and: (a) the standard MMPI scales, 


AF captains (60 in each arate 

: sample), sep 
eae ert from the assessed samples used in the deriva- 
š inhibited, 4; i ation of the scale, were 
sS. Their scores on the 


Computed also between 
Ri and the UCPOs Ethnocentrism and Fas- 
e Center, Manase cism scales. The single sample of 100 assessed 
Air Force Base, Alabama Permission js granted for F captains used in ob 
reproduction, translation, Publication, use, and dis- Correlations had 
posal in whole and in Part by or 


een included among the 
for the United grou IS el i oa : : 

States Government, Personal views or opinions ex- was the a ployed in deriving Ri: this sample 
pressed or implied in this publication are not to be Y one for which Scores on both Ri 


construed as necessarily carrying the officia] sanction 20d the UCPO scales were available. 

of the Department of the Air Force or of the Air Re- All the findings are listed in T bles 1, 2, 3 

search and Development Command. and 4, In Tables 1, 2, 3, 
? The author is very much indebted 


to Harrison Prominen, 
Gough for his advice and encouragement and for various in = among the major correlates are 
his critical reading of a Preliminary version of the z lces of 


3 Acknowl ‘ 4 
for many valuable suggestions and for Permission to Service fae a 1S made to Educational Testing 
use the data and facilities of the Institute, . E 


this test available prior to its 
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Table 1 


Correlations of Ri with Scales of the MMPI 
for Two Samples of AF Captains 


Table 3 


Correlations of Ri with Tests of Cognitive Functioning 
for Two Samples of AF Captains 


Scale 2 F r r 
(N = 60) (N = 60) Test (v=60) (N=60) 
L 
F =n = Intelligence tests: 
K 57” —59** Terman Concept Mastery —.33* KE 
Hs —10 ‘05 Idea Classification =% Slo: 
D 32* 43** w 
Hy B. 26° 95 Creativity tests:* 
Pa =AF — 10 Unusual Uses —,34"* —.28* 
Mf a Gestalt Transformation —.23 —.24 
P .16 16 
a 00 —.16 
t AS 41** * Significant at the .05 level. 
Sc he E ** Significant at the .01 level. 
Ma 3 oe a Correlations were computed, in one of the above samples, 
-24 03 between Ri and other tests from the creativity battery, includ- 
Si ose" 738" ing Plot Titles, ‘Match Problems, Consequences, and Contro! 
A Gailan miet ) ag" ST ‘Association. These correlations were all approximately zero. 
Es : anxiety P 5 
Ip (eap areng) i oe A second cluster of correlates suggests that 
ship) a à high Ri persons are likely to be anxious and 


* z 
*Sififeant at the 1 level 
a as opposed to lows, would appear to be 
$ ly introverted (Si, Sy), submissive (Do); 
nan relatively deficient in personality at- 
ributes associated with social presence ( 
and with leadership ability (Lp). 


Table 2 
Correlations of Ri with Scales of the CPI 


for Two Samples of AF Captains 


r r 
(w=60) (N=60) 


depressed U Dy; self-dissatisfied, and em- 
hatic in the expression of their complaints 
(Sa, K, Wb). 

There are indications also that high scorers 
tend to be less intellectually efficient (Ie), 


less interested in and motivated toward scho- 
Ai),* less original 


lastic achievement (Ac, 
(Unusual Uses), and slightly less intelligent 
than low scorers. 

The correlations of Ri with the Tolerance, 
Fascism, and Ethnocentrism scales accord 
with the findings from various other studies 
which reflect an association between rigidity 
and prejudice. 

The Es scale, which is negatively related to 
Ri, was derived by contrasting the item re- 
sponses of patients who did and patients who 


Table 4 


Correlations of Ri with Scales of the UCPOS 
for a Sample of AF Captains 


r 
Scale (N=100) 

F (fascism) as" 

E (ethnocentrism) .23* 


Scale 
Do (dominance) =at —.59"* 
Cs (capacity for status) —.55** — 55" 
Sy (sociability) — 70% —.72* 
p (social presence) ee 
y (self-acceptance) -a tl 
Vb (sense of well-being) age a 
Re (responsibility) —16 —34" 
So (socialization) —.08 10 
Sc (self-control) 06 19 
To (tolerance) Sor 61** 
Gi (good impression) — 32" ase 
Cm (communality) —.03 -2r 
Ac (achievement via conformance) —52"* —.50* 
a (achievement via independence) ~.50" -23 
i (intellectual efficiency) =." 62%" 
a (psychological-mindedness) e 
x (flexibility) nae et 
29* 21 


Fe (femininity) 


* Stans 
Significant at the .05 level. 
ignificant at the .01 level. 


* Significant at the .05 level. 
a 

4The Ac and Ai scales were derived by selecting 
items capable of discriminating between high and 
low achievers at the high school (Ac) and college 
(Ai) levels. 


374 John M. 
did not benefit from psychotherapy (1). High 
Es scores are predictive of a favorable thera- 
peutic outcome. The present implication of a 
negative relation between rigidity and ca- 
pacity for improvement in psychotherapy ap- 
pears reasonable; for it is quite probable that 
the modification in patient personality, seem- 
ingly involved in a beneficial therapeutic 
process, is facilitated by psychological flexi- 
bility. ; 
The negative correlations with the Flexi- 
bility scale were naturally anticipated. That 
the correlations are not larger is probably a 


n a rational a priori 
manner (2), whereas Rj was derived by em- 
Pirical analysis. 

Finally, there are indications (Cs) that 
qualities assessed by Ri are negatively re- 
lated to Capacity for high social status, 


Summary and Conclusions 


ned as Poise, spontaneity, 


; (b) submissive and 
low in leadership qualities; (c) anxious and 


Rehfisch 


from those employed in the present study. The 
qualities listed above may therefore be con- 
sidered fairly stable Ri correlates for the Kinds 
of subjects used in defining the scale, i.e., 
adult males (university students [5] and AF 
Captains) who were, as a group, above the av- 
erage in intelligence and education. 

There were indications also, among the cor- 
relating scales, of a positive association be- 
tween Ri and prejudice. Such a relationship 
had not been specifically indicated by the as- 
Sessor descriptions; Prejudice may, accord- 
ingly, be a somewhat less salient and/or re- 
liable correlate of the Ri scale than the other 
qualities listed above. 
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ik 
he Effect of Cultural Factors on the Relationship 


| Between Personality, Intelligence, and 
Ethnocentric Attitudes 


Aron Wolfe Siegman 


Bar-Ilan University, Israel 


_ Many invest 
in kde: ope era have been undertaken roticism scale (5), was administered as an 
| Which are etermine some of the variables index of Ss’ adjustment level. All Ss were also 
associated with ethnocentric atti- administered Gough’s Pr scale (7), which 
consists of personality oriented MMPI items 


udes, F 
» Prenk . 
nkel-Brunswik and her associates 
which discriminated between high and low 


ave rey : 
aia fairly high correlations between 
ology of is attitudes and authoritarian ide- scorers on an anti-Semitism scale. There is 
thors hay e fascistic variety (1). Some ai- evidence to suggest that a high Pr scale score 
tudes o suggested that ethnocentric atti- is associated with personality maladjustment 
7stment a with personality malad- (7, 9): 
) 12). V ,1, 9) and lower intelligence (6, Jt has been demonstrated that vocabulary test per- 
Paid fo A ii little attention, however, was formani eel Bis nt Laws on 
. R i ce te: vide var 
one see whether these obtaine an ieyual abilities (14). In ie present ea 
ay not be a function of the Vocabulary test of the Shipley-Hartford (S-H) Re- 
10) was used to determine Ss’ intelli- 


Egree 

to whi 

Centric At the culture sanctions ethno- treat Scale ( 

Tesent st itudes. The major purpose of the gence level. In order to raise the ceiling of the test, 
ship pep ww” Was to investigate the relation- 3 nce minute time limit was impósěd. 

alit, etween authoritari i Ina recent study W! 

one maladj uthoritarian ideology, person- pip between i 

ne hand justment, and intelligence on the j was fou Srat it was not SO ae oe eae 
Other han and anti-Negro attitudes on the of the F Scale items, 
tudents acquiesce” and answer “True, 
t, which was responsibl 


ha ; 
Who w nd, in a group of college 5 


ere " 3 
Study ot raised, and at the time of this an en Se scale 
ed in the South. 8 This finding raises the problem whether the 
same exp! tion may not be true for the frequently 
oted neg ive correlation between Ss’ F scale and 
test scores (1, 3, 6 11). Consequently, 


Method 
intelligence ini 
s jn this $ also administered a reversed 


Subj 
Jec : 
N ts. The Ss were 41 University of 
F scale (2)- eness, Ss were as- 


mize defensiv 


Orth C 
arolina 

un whom a. 
tee born, rai dergraduates, all of his Ai order to mini Ss s 
dy resid ised, and at the time of tHe signed numbers and requested not to indicate their 
es ed in the South names 0D the attitude and personality questionnaires. 

res. All S: Basta the six 

SW ed the Sv : : 
ere administer Results a nd Discussion 


s Ss’ mean and standard devia- 


S fro 
oe m the E scale which pertai® 
the various tests. Table 2 indi- 


es (1 5 
Pp. 255.087 142), and a 29-item F scale (1, Table 1 list 
). The Taylor MAS (13); which ion scores OP 
ant correlations were ob- 


Wa: 
$ fou 
nı . 
d to correlate .92 with a general neu- Cates that n0 signific 
) E scale scores on the one 


1 
Mis. 
thop US investigati i tween SS 
Ww igation w ted while the au- tained betwee 
tua e at the pe T Carolina. THE hand, an their Taylor MAS, Gough Pr, and 

havior, 4 supported in part by # om the oH vocabulary te the other hand. 
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This finding is clearly consistent with the hy- 
pothesis that neither neuroticism nor intelli- 
gence is significant sources of variance in cul- 
turally accepted ethnocentric attitudes. 

Table 2 indicates that a significant positive 
correlation was obtained between Ss’ E scale 
and F scale scores. The correlation, however, 
was significantly lower than the correlations 
which have been obtained by the authors of 
The Authoritarian Personality (1, p. 263) for 
non-Southern groups (average r = .77). This 
finding suggests that the magnitude of the 
correlation between a particular set of ethno- 
centric attitudes and authoritarian ideology, 
or authoritarianism as a personality variable 
(1), decreases with increased cultural ap- 
proval of such ethnocentric attitudes. 

Table 2 indicates that a significant negative 
correlation was obtained between Ss’ F scale 
(but not reversed F scale) and S-H vocabu- 
lary test scores. Significant positive correla- 
tions were obtained between Ss’ F scale scores 
on the one hand, and their Taylor MAS and 
Gough Pr scale scores on the other hand. 
These results are consistent with the hypothe- 
Sis that intelligence and neuroticism are sig- 
nificant sources of variance in authoritarian 
ideology. The finding, however, that neither 
neuroticism nor intelligence was a significant 
source of variance in culturally approved eth- 
nocentric attitudes, certainly suggests the pos- 
sibility that the contribution of neuroticism 
and intelligence to authoritarian ideology too 
may decrease with increased cultural approval 
of such ideology. In fact, the correlation þe- 
tween Ss’ Taylor MAS and F scale scores in 
the present study was significantly lower than 
the correlation which was obtained by Davids 
(3) in a group of Harvard students (.69) 
whose mean score per item on the F scale 


Table 1 


Ss’ Mean and SD Scores on the Various 
Psychological Tests 


Tests Mean SD 
F scale 99.51 15.37 
E scale 19.73 6.60 
Taylor MAS 15.15 7.80 
Gough Pr scale 10.51 5.01 
S-H Vocabulary MA 16.42 1.15 


Aron Wolfe Siegman 


Table 2 


Correlations Between the E and F Scales and 
Other Psychological Tests 


S-H 
Vocab- Taylor Gough E F 
Tests ulary MAS Pr scale scale 
E scale —.03 .16 -06 
F scale —.38* 3i s= AF 
F scale —.14 -03 -08 —.001 
(reversed) 


* Significant at the .05 level, 
** Significant at the .01 level, 


(2.97) was lower than 


that of the present 
group (3.43) .2 


Summary 


No significant Correlation was obtained, in 
a group of Southern undergraduates, between 
Ss’ performance on an anti-Negro bias (E) 


scale and Ss’ Taylor MAS, Gough P, 
Shipley-Hartford vocabul ig hog 
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A Note on the Behavioral Validity of the 
Gordon Personal Profile 


Warren W. Willingham, Paul Nelson, and William O’Connor? 
U. S. Naval School of Aviation Medicine 


Whereas personality scales are designed to 
indicate behavioral tendencies, it is generally 
difficult to find consistent behavioral criteria 
upon which to validate the scales. The present 
study takes advantage of such behavioral 
criteria extant in the Naval Air Training Pro- 
gram. While it is understood that a student 
may withdraw from flight training at any 
time, there is considerable pressure from peers 
and instructors to “stick it out.” Some stu- 
dents drop for good reason, but in most cases 

the action is no clearer than a vaguely ex- 
pressed “distaste for the situation.” The 

Gordon Personal Profile has a scale termed 
Responsibility which is defined as follows: 
“Individuals who are unable to stick to tasks 
that do not interest them, and in the extreme, 
who tend to be flighty or irresponsible, usually 
make low scores on this scale” (1). The pri- 
mary purpose of this study was to validate 
this scale against the criterion of voluntary 
withdrawal. A matter of secondary interest 
was the extent to which the Emotional Sta- 
bility scale of the Profile was related to flight 
failure. A negative relation would be expected 
since anxiety or tenseness often hampers flight 
performance. 

In the fourteenth week of preflight training, 
1039 cadets completed the Gordon Personal 
Profile. Six months later, 95 had flight failed, 
and 117 had withdrawn voluntarily. The re- 
maining 887 cadets were categorized as “suc- 
cessful.” Table 1 shows the point-biserial cor- 
relation between each scale and each type of 
attrition. The data show consistent zero rela- 


1 The views expressed here are not to be construed 
as necessarily reflecting those of the Navy. 
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tionships. The frequency distributions of Total 
Score and the two subscales in question were 
examined in search of a discriminating cutoff 
which might be used in lieu of linear correla- 
tion statistics. From this analysis it was evi- 
dent that the very low scoring students did 
not fail or withdraw at a higher rate. 


Table 1 


Means, Standard Deviations, and Validity Coefficients 
on the Gordon Personal Profile 


Validity 
coefficient 
ee 

With- 

Scale M SD draw Failure 
Ascendancy 5:2 53 .03 .00 
Responsibility 7.2 5.0 03 —.03 
Emotional Stability 8.0 5.5 .04 —.04 
Sociability 5.0 5.6 .00 —01 
Total Score 25.5 12.5 04 —.03 
eee 


In summary, the scales of the Gordon Per- 
sonal Profile were not related to the behavioral 
- Recognizably, the 
least some positive 
been found. These 
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The Effects of Chlorpromazine on Learning in Chronic 
Psychotics* 


William A. Whitehead * 


and Leland E. Thune 


Vanderbilt University 


This study represents an attempt to explore 
the effects of the drug chlorpromazine on sev- 
eral different aspects of the learning process 
and on verbalized social adaptation as these 
take place in a group of hospitalized chronic 
psychotic subjects (Ss). The learning vari- 
ables sampled included serial verbal learning, 
retention of serial verbal material learned on 
the previous day, the acquisition of a motor 
skill, reminiscence of this motor skill, problem 
solving, and a somewhat related task involv- 
ing verbalized social adaptation and judg- 
ment. These tasks would seem to tap various 
levels of the learning process, ranging from 
simple motor learning to problem solving and, 
finally, “social adaptation.” Inasmuch as this 
was an exploratory study, no directional hy- 
potheses were offered. 


Method 


Subjects and Treatment 


Fifty-two chronic psychotic male veterans, 
committed to a Veterans Administration Hos- 
pital, were studied. Ss were chosen by the 
medical staff on the basis of judgments that 
they were physically suitable for chlorpro- 
mazine treatment, that they would be able to 
cooperate when tested with a battery of sim- 


i icle i f a dissertation 
1 This article is based upon part o 6 1 
submitted to the Graduate School, Vanderbilt Uni- 
versity, in partial fulfillment of the requirements for 
x ior author and written 
irecti j hor. The study 
he direction of the junior autho I 
A out at the Veterans Administration Hos- 
pital. Murfreesboro, Tennessee. Much aid was given 
by F H. Deter, H. B. McTyre, and other members 
of the hospital staff. k ; 
2 Now a Central State Hospital, Nashville, Ten- 


nessee. 


ple psychological tests, and that they were 
free from organic disturbances which might 
influence their behavior. The majority of the 
Ss carried the diagnosis of one of the subtypes 
of schizophrenia, but there were several who 
were classified as manic-depressive. Ss were on 
the Continued Treatment Service where they 
received the same routine ward care to which 
they had become accustomed. None of the Ss 
received any other type of somatic therapy 
during the period of study, but several Ss 
were members of an activity group. Prior to 
treatment, Ss were randomly divided into two 
groups; one of which was later designated as 
an experimental group and the other as a 
control group. The physician who took charge 
of ordering the medication arbitrarily desig- 
nated these groups. No other hospital person- 
nel were aware of which was the experimental 
group and which was the control group. The 
mean age for the experimental group was 38 
and for the control group was 39. The mean 
duration of hospitalization was 8.9 years for 
the experimental group and 7.8 years for the 
control group. 

All Ss in the experimental group were placed 
on oral chlorpromazine for a period of two 
months. Dosage was gradually increased to 
about 800 mg per day, usually over a period 
of about 35 days, and then gradually de- 
creased until evaluation, at which time 36 Ss 
were receiving a minimum of 300 mg, and 16 
Ss were receiving 200 mg per day. Equal num- 
bers of control and experimental Ss were rep- 
resented in each minimum dosage group. Ss 
in the control group received placebos pre- 
pared by the Smith, Kline, and French Drug 
Co. All Ss received the same routine labora- 
tory procedures. 
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Procedure 


All Ss were tested individually in two ses- 
sions on two consecutive days. 


A pursuit rotor apparatus was used to measure 
motor skill acquisition. The turntable was set to run 
in a clockwise direction at 40 rpm. A chronoscope 
measured the “time on target.” Instructions were fol- 
lowed by 8 trials of 45 sec. each, with a 15-sec. rest 
interval between trials. If S refused to do the task in 
spite of urging, a subjective judgment was made as 
to whether he would be able to cooperate on any of 
the other tasks. Sometimes the testing procedure had 
to be stopped at this point. 

A Lane-type memory drum was used in the verbal 
learning and retention tasks. The following 8-item 
list was learned by the serial anticipation method: 
sand, tool, dust, inch, pain, robe, junk, year. Each 
word was exposed for 3 sec., and individual trials 
were separated by a 6-sec. rest interval. The word 
list was exposed 20 times, or until it had been 
learned to a criterion of three consecutive complete 
repetitions, whichever occurred first. 

After completing the serial learning task, S re- 
turned to the pursuit rotor where he received five 
additional trials. 

A questionnaire called the Verbalized Social Adap- 
tation Questionnaire was developed specifically for 
the study.? The questionnaire consisted of a series of 
statements which presumably contained a principle 
by which social cooperation could be elicited. Each 
Statement was followed by a question with two al- 
ternative answers. The answer which made use of 
the “principle” given in the Statement was consid- 
ered correct. Following is an example of one of the 
items: “A person who is lost in a strange city can 
often find out how to get where he wants to go by 
asking someone who lives there, If you were lost in 
a strange town, would you: (a) Ask directions from 
a policeman, or (b) Look carefully at all the street 
signs until you found the one you wanted?” Thirty- 
six such items were formulated. The 36 questions 
were divided into two forms of 18 questions each, 
The items were read to each S individually, It was 
felt that a “correct” answer implied a higher level 
of social adaptation, or judgment, than did an “in- 
correct” answer. One-half of the Ss received Form I 
of the questionnaire on the first day, and the other 
half received Form II on the first day. 

Upon his return to the testing room on the second 
day, S was first given 10 additional serial anticipa- 
tion trials, hereafter called retention trials, with the 
same word list which he had learned the previous 
day. 

ite completing this task, S$ worked on the Mak- 


3 George E. Copple initiated the concept of the 
Verbalized Social Adaptation Questionnaire and de- 
veloped several of the items. A copy of the question- 
naire has been deposited with the American Docu- 
mentation Institute. Order Document No. 5583, re- 
mitting $1.25 for 35-mm. microfilm or $1.25 for 6 
by 8 in. photocopies. 
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ing the Last Draw Problem (3, p. 140). This prob- 
lem was chosen because of its comparative simplicity, 
and its difficulty level is easily altered. The first 
phase of the problem used four matchsticks as ma- 
terial. If the S was able to solve this task three con- 
secutive times out of five trials, he was asked whether 
or not he could give a rule whereby he could tell 
someone else how to win the game every time. Those 
who were unable to solve the problem three con- 
secutive times were told the principle and then given 
three additional trials. For Ss who were able to solve 
the first problem, the next level utilized five match- 
sticks as materials; those who failed the first prob- 
lem, even with help, did not continue to the second 
level. The five-stick problem was administered in the 
same manner as the four-stick problem. For those 
who solved the second problem, the last problem 
utilized seven matchsticks, and it was administered 
in the same way the first two problems had been, 

The last measurement taken on the second day was 
the alternate form of the social adaptation question- 
naire, and it was administered in the same manner 
as it had been the day before. 


Results 


During the course of the testing it was im- 
mediately apparent that many Ss could not 
perform on one or more of the tasks. Some Ss 
were able to cooperate on one of the tasks 
and not on another. The judgment as to 
whether or not an S was testable was made 
on a subjective basis. The judgment was, how- 
ever, based on the observed behavior of the S, 
and if there was any question as to his fitness 
for undertaking a given task, an attempt was 
made to gain his Cooperation. At the time of 
the testing, E was not aware as to which indi- 
viduals were being given the drug and which 
were receiving placebos, 

It is felt that the “testable—-not testable” 
factor is itself an important source of infor- 
mation as to the broader behavioral effects of 
the experimental drug. A more direct measure 
of the effect of chlorpromazine on learning 
performance per se is obtained by comparing 
the performance records for those Ss in each 
group who were able to undertake each task. 


Serial Verbal Learning 


able. 7 square figure of 
9.6 is significant at less than the .01 level. 


When testable Ss in each group were com- 


y 


Effects of Chlorpromazine on Learning 


pared on individual original learning and re- ` 


tention learning trials, none of the results ap- 
proached significance. There was also no sig- 
nificant difference between groups when the 
sums of individual scores were compared. The 
Median Test was used to make these com- 
parisons. 


Motor Skill Acquisition 


A significantly larger number of Ss in the 
chlorpromazine group, 24, than in the placebo 
group, 16, were found to be able to undertake 
the pursuit rotor task (x? = 6.9, p < 01). 

When the nonparametric White’s Test was 
applied to each of the trials and also to the 
sums of individual scores on all of the trials 
for both the original learning phase and the 
reminiscence phase, the results did not indi- 
cate a significant difference between groups. 


Problem Solving 

Twenty-one chlorpromazine Ss were test- 
able on the problem-solving task, while only 
15 placebo Ss were testable. However, the re- 
sulting chi square of 3.6 is not considered sig- 
nificant for purposes of this study. No sig- 
nificant differences were obtained when the 
groups were compared on the number of cor- 
rect solutions to each of the problems by 


means of the chi-square test. 


Verbalized Social Adaptation 
When the two groups were compared on the 
testable-not testable split by means of the 
chi-square test, significantly more Ss in the 
chlorpromazine group, 23, were testable than 
in the placebo group, 16 (x? = 6.3, $ < 02). 
In analyzing the data in this section, the 
Median Test was used in preference to White’s 
Test because the large number of ties pre- 
cluded the efficient application of White’s 
Test. When the groups were compared with 
regard to the number of correct items on 
both forms of the questionnaire, the groups 
differed at less than the .05 level. The groups 
were also significantly different when com- 
pared on each form separately. In all in- 
stances, the ca group had signifi- 
items correct. 
EE ee TO obtain some check on the reli- 
ability of the two forms of the questionnaire 
and also to get some indication of the reli- 
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Table 1 


Summary of Statistical Findings 


Testable— Testable 
Task not testable S’s only 
Serial verbal 
learning 
Original x2 <.01 MT NS 
Retention xX <.01 MT NS 
Pursuit rotor 
learning 
Original xX <.01 WT NS 
Reminiscence x <.01 WT NS 
Problem solving 
Four sticks x? NS x NS 
Five sticks xX NS x NS 
Seven sticks x? NS x? NS 
Verbalized Social 
Adaptation 
Form I MT<.05 
Form IT MT<.05 
Combined forms xX <.02 MT<.05 


a The test employed and the obtained level of significance is 
indicated in each case, MT indicates Median Test; WT indi- 
cates White's Test; NS indicates not significant at the .05 level, 


ability of the individual’s responses to the 
two forms, a Pearson correlation coefficient 
between the two forms was calculated. The 
resulting coefficient of .85 is significant at less 
than the .01 level. 


Summary of Statistical Findings 


Table 1 presents a brief summary of the 
statistical findings. Rather than presenting the 
findings for the individual trials on the verbal 
and motor learning tasks, the table shows the 
results for the sums of individual scores on 
all trials combined. The other table headings 
refer to previously mentioned tests. 


Discussion 


Effects of Chlorpromazine on Level of Coop- 
eration 

Because of the differences between the two 
groups on the testable-not testable factor on 
all of the tasks except the problem-solving 
task, it is inferred that chlorpromazine in- 
creases the motivational level of chronic psy- 
chotic patients to the extent that they are 
willing (able) to try the tasks which were 
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presented. Although the drug seems to have 
little effect on the learning processes them- 
selves, it appears to have a definite effect on 
motivational factors associated with the proc- 
ess of learning. ‘ 
One of the reasons that previous studies 
have indicated such a large discrepancy be- 
tween the learning of psychotic groups and 
normal control groups may be that most re- 
search workers have not adequately controlled 
for differences in levels of motivation and co- 
operation. The findings of the present study 
regarding the differences between the two 
groups on the testability factor would seem 
to lend some support to the hypothesis that 
motivation is one of the key factors in the 
learning deficit found in psychotic groups. It 
may not be that the chronic psychotic pa- 
tients are unable to learn as efficiently as 
normals but, rather, that they are more handi- 
capped by the pressure to reduce anxiety or, 
as Hunt (2) suggested, social approval has 
lost its reward value. 


Effect of Chlorpromazine on Learning Tasks 


There were no significant differences be- 
tween the two groups on the serial verbal 
learning task. This finding suggests that 
chlorpromazine does not significantly affect 
the learning processes involved in verbal 
learning but, rather, that it does have some 
influence on the motivational aspects of such 
learning. It was further noted that the learn- 
ing curves for these samples of chronic psy- 
chotic Ss were similar to those reported with 
other types of Ss. 

The results of the present study would seem 
to indicate that chlorpromazine has little ef- 
fect on the acquisition of simple motor skills 
among those Ss who were able to undertake 
the task. In spite of clinical reports to the 
effect that chlorpromazine induces general 

psychomotor retardation, this retardation did 
not significantly decrease the motor learning 
ability of this group. It may be that there 
was a two-factor effect operating on the mo- 
tor task such that the psychomotor retarda- 
tion produced by chlorpromazine lowered the 
rate of learning while the increased motiva- 
tion and interest enabled the group to do as 
well as the control group. It was also noted 
during the course of the testing that sev- 
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eral Ss whose behavior and appearance was 
“Parkinsonian” were still able to learn the 
motor task at about the same rate as other Ss. 

On the problem-solving task, the groups 
did not differ significantly even on the test- 
able-not testable split. It will be noted, how- 
ever, that the groups differ at the .10 level 
in the direction that more Ss in the chlor- 
promazine group were testable. Apparently, 
chlorpromazine has little effect on this par- 
ticular problem-solving task. 


Verbalized Social Adaptation 


There were Statistically significant differ- 
ences between the two groups on all phases 
of the Verbalized Social Adaptation Question- 
naire. It should be recognized that the only 
validity claimed for this instrument is its face 
validity. 

In formulating the rationale for the ques- 
tionnaire it was felt that the items might have 
some relevance to what might be called 
“readiness for psychotherapy.” The ability to 
make generalizations from the therapeutic 
situation to a particular problem in life would 
seem to be a necessary, but not a sufficient, 
requisite for therapeutic progress. It would 
seem that patients who were unable to cor- 
rectly answer most of the items on this ques- 
tionnaire would be poorer therapeutic risks 
than would those patients who answered most 
of the items correctly. If one accepts this 
rationale, then the conclusion that psychotic 
patients receiving chlorpromazine are more 
accessible to Psychotherapy does not seem 
unwarranted. 

A secondary rationale for the relevance of 
the items to “readiness for psychotherapy” is 
that those individuals who are more aware of 
and concerned with their social environment 
would seem to be able to form a more satis- 
factory therapeutic relationship than patients 
who do not have this interest. One of the most 
difficult problems in doing psychotherapy with 
chronic psychotic patients is to arouse their 
motivation and interest in the social environ- 
ment to the extent that it will be possible to 
build a therapeutic relationship. The find- 
ings on this questionnaire would seem to in- 
dicate that chronic Psychotic patients receiv- 
ing chlorpromazine are more concerned with 
their social environment, 


Effects of Chlorpromazine on Learning 


Implications for Psychotherapy 


If it is assumed that chlorpromazine exer- 
cises its beneficial effects by reducing over- 
all anxiety, then some speculations regard- 
ing theoretical implications for psychotherapy 
may be made. If the psychotherapeutic inter- 
view is viewed as a learning situation, and if 
the learning tasks used in this study have any 
relation to the type of learning that takes 
place in therapy, these data should offer some 
information which may be integrated into the 
theory of anxiety reduction in psychotherapy. 

Assuming that chlorpromazine reduces anx- 
iety in the chronic psychotic, the finding that 
there were no significant differences between 
the two groups on the verbal, motor, and 
problem-solving tasks seems to be contrary 
to the hypothesis that a reduction in anxiety 


level would result in more effective learning. 


However, the finding that the chlorpromazine 
groups are more cooperative and seemingly 
more interested in their social environment 
suggests that while anxiety reduction may 
not directly influence the learning processes, 
it may influence other relevant factors which 


make new learning possible. 


Summary 


cts of chlorpromazine upon the per- 
formance of chronic psychotic Ss on several 
learning and retention tasks were studied. 
Fifty-two Ss were randomly divided into two 
groups, an experimental group which received 
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chlorpromazine for a period of two months 
and a control group which received placebos. 
At the end of this period Ss were examined on 
a serial verbal learning task, a motor learn- 
ing task, a problem-solving task, and on a 
questionnaire called the Verbalized Social 
Adaptation Questionnaire. The following con- 
clusions were drawn: 

1. Chlorpromazine appears to have little 
effect on the learning processes per se. 

2. Chlorpromazine has a significant effect 
on improving the responses of chronic psy- 
chotics to items judged to involve social adap- 
tation. 

3. Chlorpromazine significantly increases 
the number of chronic psychotic Ss who are 
motivated to cooperate in the testing pro- 
cedure. 

4. In spite of reports to the effect that 
chlorpromazine produces general psychomotor 
retardation, Ss receiving the drug learn a mo- 
tor task at the same rate as Ss who are not 


receiving the drug. 


Received August 15, 1957. 
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Stylus Maze Performance of Chronic Schizophrenics 
Taking Chlorpromazine’ 


Paul G. Daston ° 


Veterans Administration Hospital, Brockton, Massachusetts 


Conflicting reports have been published re- 
garding Porteus maze performance of chronic 
schizophrenics treated with chlorpromazine 
(CPZ). The present study employs a stylus 
maze to investigate effects large doses of 
CPZ may have on performance of chronic 
schizophrenics when practice effect is mini- 
mized. 

Ss were 16 chronic schizophrenics, divided 
into CPZ (1200 mg. daily) and placebo (PL) 
groups. Ritalin was added for CPZ Ss the 
first 15 days and for PL Ss instead the last 
4 days. All had 27 previous weekly trials, with 
performances approaching an asymptote. 
Groups were equated for performance and 
tested daily for 19 days. Apparatus was a 
Lafayette stylus maze, wired to record er- 
rors. The stylus traced the path taken on a 
paper schematic placed under the maze, thus 
recording extent of blind alley penetration. 
Time was kept by stop watch, Ss were told 
to take the shortest path to the goal without 
touching the sides, to avoid blind alleys and 
to work as fast as possible. 


1An extended copy of this report may be ob- 
tained without charge from Paul G. Daston, Clinical 
Psychology Section, Veterans Administration Hos- 
pital, Durham, N. C., or for a fee from the Ameri- 
can Documentation Institute. Order Document No. 
5691, remitting $1.25 for microfilm or $1.25 for 
photocopies. 

* Now Chief Psychologist at Durham (N. C.) Vet- 
erans Administration Hospital. 

3 Ritalin, a “psychic energizer,” purports to mini- 
mize such side effects of CPZ as drowsiness and 
mood depression. 


As time and error scores were related (Ss 
taking more time tended to make fewer er- 
rors), each measure was transformed into 
standard scores and both combined. Analyses 
of variance, using difference scores, revealed 
no significant differences between groups, 
either for 1st vs. 15th day, 15th vs. 19th, or 
Ist vs. 19th day. In no case did the F ratio 
exceed 1, indicating CPZ, with or without 
Ritalin, had little effect on performance or, 
inferentially, perceptual-motor coordination. 
However, inspection of means revealed CPZ 
group performance remained about the same 
with or without Ritalin, whereas PL mean 
scores improved with its addition, Also, chi- 
Square tests of direction of change showed a 
significant shift (p = .05) favoring PL im- 
provement. 

It was felt extent of blind alley penetration 
might give a measure of judgment. A number 
Score was assigned to each 16th inch of blind 
alley penetration. Statistically significant dif- 
ferences were found between groups for the 
first measure, so analysis of covariance was 
used. Differences were not significant for 
either 15th or 19th day, indicating judgment 
Was not affected differentially by CPZ. 

In summary, perceptual-motor coordination, 
as measured, was not affected significantly by 
large doses of CPZ. PL errors tended to de- 
crease, Judgment, denoted by extent of pene- 
tration into blind alleys, was not differentially 
affected. Ritalin effect warrants further study. 
Brief Report. 

Received May 19, 1958. 
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The Effect of Differential Motivating Instructions on 
the Emotional Tone and Outcome of TAT Stories’ 


Harriet C. Sumerwell, Mary M. Campbell, 
and Irwin G. Sarason* 
University of Washington 


This study was carried out to achieve two 
goals. The first was to determine the extent 
to which we could replicate certain of Eron’s 
(1, 2, 3) findings concerning his scales for 
scoring Emotional Tone and Outcome on the 
TAT. In particular, we were interested in 
whether or not the reliabilities of raters and 
pull values of the TAT cards in our study 
would approximate those obtained by Eron 
in his normative study. 

Our second objective was to assess the sensi- 
tivity of Eron’s Emotional Tone (ET) and 
Outcome (O) scales to experimental instruc- 
tions introduced prior to obtaining subjects’ 
stories to the cards. One of the widely used 
sets of TAT instructions in research and clini- 
cal work is that of Murray (4). Therefore 
Murray’s instructions (adapted for group ad- 
ministration) constituted one of four sets of 
instructions used in this experiment. In ex- 
amining Murray’s instructions, it seemed to 
us that they either directly or indirectly pro- 
vide the subject with information which might 
lead him to draw the inference that the test 
he is about to take is some combination of 
an intelligence and personality test. We at- 
tempted to separate these two possible effects 
by employing another set of instructions in- 
forming the subject he was about to take an 
intelligence test and still another set inform- 
ing the subject he was to take a personality 
test. Our fourth set consisted of neutral in- 
structions which merely informed the subject 
er were presented at the 1957 
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nsible for the manuscript 
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of the procedure he was to follow in respond- 
ing to the cards. 

For the present purposes we assumed that 
the ET and O ratings would reflect the de- 
gree of stress experienced by the subject and 
that the lower the ratings (i.e., greater dys- 
phoria) the greater was the subject’s reaction 
to stress. Our hypothesis concerning the ef- 
fects of the differential instructions was that 
the Murray instructions would be the most 
stressful of the four sets used and that the 
neutral instructions would be the least stress- 
ful. Consequently, we expected relatively low 
ET and O ratings under the Murray instruc- 
tions and relatively high ratings under the 
neutral instructions. The ET and O ratings 
for the Projective and Intelligence instructions 
were expected to fall between those obtained 
under the Murray and Neutral instructions. 


Method 

Subjects 

The Ss were 106 volunteers from introduc- 
tory psychology classes at the University of 
Washington. The total number of Ss in each 
group was as follows: Murray—20, Intelli- 
gence—22, Projective—42, and Neutral—22. 
Half the Ss in each group were tested by one 
E, and half by the other Æ. There were equal 
numbers of males and females in the Murray, 
Intelligence, and Neutral groups, although we 
had made no systematic attempt to control 
for the sex variable. In the Projective group, 
females outnumbered males 29-13. 


Procedure 
Eight TAT cards—1, 2, 4, 6BM, 13MF, 
16, 18GF, and 18BM—were presented to each 
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group of Ss by projection upon a screen after 
the appropriate instructions had been given. 
Each picture was exposed for five minutes, 
during which time the Ss wrote their stories. 
The four sets of instructions were adminis- 
tered as follows: 


1. Murray instructions. This is a test of imagina- 
tion, one form of intelligence. I am going to show 
you some pictures, one at a time; and your task will 
be to make up as dramatic a story as you can for 
each. Tell what has led up to the event shown in 
the picture, describe what is happening at the mo- 
ment, what the characters are feeling and thinking; 
and then give the outcome. Write your thoughts as 
they come to your mind. Do you understand? Here 
is the first picture. 

2. Intelligence test instructions. Being college stu- 
dents you are probably accustomed to taking intelli- 
gence tests. This is a special test of intelligence and 
the ability to think creatively. Rather than measur- 
ing specific abilities, this test gets at innate capacity 
and potentialities. I am going to show you certain 
pictures, one at time; and your task will be to make 
up a story for each. Tell what has led up to the 

event shown in the picture, describe what is happen- 
ing at the moment, what the characters are feeling 
and thinking; and then give the outcome. Write your 
thoughts as they come to your mind. Do you under- 
stand? Here is the first picture. 

3. Personality test instructions. You have probably 
heard of projective techniques and tests. The test you 
are about to take is the Thematic Apperception Test. 
It is a projective test in the sense that you uncon- 
sciously project your inner feelings and motives into 
the stories you tell. I am going to show you some 
pictures, one at a time; and your task will be to 
make up a story for each. Tell what has led up to 
the event shown in the picture, describe what is hap- 
pening at the moment, what the characters are feel- 
ing and thinking; and then give the outcome. Write 
your thoughts as they come to your mind. Do you 
understand? Here is the first picture. 

4. Neutral instructions, I am going to show you 
some pictures, one at a time; and your task will be 
to make up a story for each. Tell what has led up 
to the event shown in the picture, describe what is 
happening at the moment, what the characters are 
feeling and thinking; and then give the outcome. 
Write your thoughts as they come to your mind. Do 
you understand? Here is the first picture. 


The four sets of instructions were group- 
administered by two different Es. Thus there 
were eight experimental groups in the experi- 
ment, and it became possible to evaluate the 
effects of the experimenter difference. 

After all the data had been gathered, the 
stories for all Ss were independently scored by 
the two Æs for ET and O. The scoring pro- 
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cedure was so arranged that neither E had 
knowledge of the group to which the S, whose 
protocol was being scored, belonged. Disagree- 
ment between raters was resolved for the pur- 
poses of the statistical analysis of the data by 
the third author (Sarason) who had had con- 
siderable experience in using Eron’s scales. 


Results 


Pearson product-moment correlations be- 
tween the ratings (made prior to resolution 
of disagreement) of the two examiners were 
‘817 for ET and .808 for O. These correla- 
tions are similar to those obtained by Eron 
(1, 2, 3) and seem to justify increased confi- 
dence in the use of this scoring system for ex- 
perimental purposes.* In general, all of the 
cards tended to elicit stories negative in both 
ET and O, a finding which again corroborated 
Eron’s and Sarason and Sarason’s earlier re- 
sults, 

The effects of the experimental instructions 
and the two examiners were evaluated by 
means of analysis of variance. The measure 
employed for each S was the sum of the rat- 
ings over all cards administered, Table 1 pre- 
sents the means and SDs of ET and O rat- 
ings as a function of the experimental condi- 
tions. Preliminary comparisons of the eight 
experimental groups indicated that the as- 
sumption of homogeneity of variance could 
be met in our statistical tests. 

In general, no significant difference between 
examiners was found for either the ET or O 
ratings. There was, however, a significant dif- 
ference at the .01 level between examiners for 
O under Neutral instructions, 

Since there were no significant differences 
between examiners for ET, the data were 
pooled into the four instruction groups. A sig- 
nificant difference at the .01 level among these 
groups was found. Significant differences be- 
tween the four pooled groups under O were 
also obtained at the .01 level. However, since 
significant examiner differences under the 
Neutral condition for the O ratings had been 


* The correlations obtained are also similar to those 
obtained by Sarason, I. G. and Sarason, B. R. in an 
unpublished study, “The effect of type of administra- 
tion and sex of subject on emotional tone and out- 
come ratings of TAT stories.” 
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Table 1 


Means and Standard Deviations of Emotional Tone and Outcome Ratings as a 
Function of Instructions and Examiners 


Average of 2 
Examiner No. 1 Examiner No. 2 Examiners 
Measure and 
instructions Mean SD Mean SD Mean SD 
Emotional Tone 
Murray —8.90 2.02 —9.20 2.39 —9.05 2.16 
Projective —8.57 2.36 —8.29 2.69 —8.43 2.50 
Intelligence —7.73 2.41 —8.55 2.34 —8.14 2.36 
Neutral —6.00 1.84 —6.73 2.28 —6.36 2.06 
Outcome 
Murray —4.10 3.70 —4.80 3.85 —4.45 3.69 
Projective —3.24 3.27 —2.19 4.04 —2.71 3.67 
Intelligence —3.45 3.83 —1.73 3.74 —2.59 3.80 
Neutral + .82 3.25 =1.91 2.02 — 55 2.99 


Note.—The measure for each S wa: 


found, a further analysis of variance of O 
iting the Neutral 


ratings was performed omi 
group. When the three remaining groups were 
compared, no significant differences were dis- 
covered among the three remaining groups. 

When ¢ tests were performed, it was found 
that for the ET ratings, the Murray, Projec- 
tive, and’ Intelligence groups differed signifi- 
cantly from the Neutral group at the AOL, 
.01, and .05 levels of confidence respectively. 
The Murray, Projective, and Intelligence 
groups did not differ significantly among 
themselves. 

With respect to the O rati 
and Projective groups were found to differ 
significantly from the Neutral group (.01 and 
‘05 levels respectively). The Intelligence group 
did not differ significantly from the Neutral 
group. As already mentioned, the Murray, 
Projective, and Intelligence groups did not 
differ among themselves on the outcome rat- 


ings. g 
It seemed of i 
lation between E 


ng, the Murray 


nterest to compute the corre- 
T and O. This r was found 
to be .385, which was low but significant at 
the .01 level. The small size of this correla- 
tion seems to be accounted for by the greater 
variability of O ratings, similarly reported by 
Eron, and the observation that Ss occasion- 
ally tended to give a happy ending quite out 
of line with the initial depressing mood of 


their story. 


s the sum of ratings over all cards administered. 


A separate analysis of card differences was 
also performed. It was found that the scores 
for individual cards differed significantly be- 
yond the .001 point for ET under the four 
instructional conditions. For O, there were 
significant card differences at the .001 point 
for Murray, Personality, and Intelligence 
groups, but no significant differences under 
the Neutral group were found. This again 
appeared to be related to examiner differ- 
ences under the Neutral condition. 

In testing for the effect of instructions upon 
cards, the coefficient of concordance was used, 
the cards being ranked on the basis of their 
mean scores obtained under each of the ex- 
perimental conditions. It was found that in- 
structions did not alter the ranks of the cards 
significantly. Thus it appears that a card re- 
tains its original pull value relative to the 
other cards in spite of the over-all effect of 


varied instructions. 


Discussion 


With respect to the hypotheses we made 
concerning our experimental procedure, it ap- 
pears as though they were supported by our 
results. Happier emotional tone and outcome 
were more associated with the Neutral in- 
structions than with the other instructions 
employed. Although this study does not pro- 
vide sufficient basis for delineating precisely 
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the reactions of the Ss to the instructions, it 
seems reasonable that negative ET and O 
scores are associated with emotional upset, 
tension, and dysphoria. In this regard we 
wonder whether instructions such as Murray’s 
do not impose undue stress and structure on 
the testing situation. We generally interpret 
S’s reactions to the TAT in terms of the 
test stimuli presented to him and in terms 
of characteristics peculiar to the individual. 
However, there may be a third variable we 
overlook in test administration, namely, the 
influence of our preliminary instructions on 
S’s behavior. If our aim in testing is to re- 
duce the degree of structure in the test situa- 
tion, perhaps instructions similar to those we 
would call Neutral would be more appropriate. 

Our results have provided further basis for 
employing Eron’s rating scales for research 
purposes. With respect to reliability and other 
characteristics, our results are generally con- 
sistent with those reported by others. It would 
seem useful in future research to study the 
relationship of these and other rating scales 
to a variety of behavioral criteria and experi- 
mental procedures. 

Frequently widely different stories achieved 
similar ratings on Eron’s scale. We feel that 
other rating scales designed to tap a variety 
of personality dimensions and content areas 
might yield pertinent information about Ss’ 
differences to which the ET and O scales are 
relatively insensitive. Further research might 
be directed toward devising other scales and 
later towards investigating the meaning of § 
differences along these dimensions. 
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Summary 


The effects of four kinds of instructions and 
of two different examiners on TAT emotional 
tone and outcome ratings were studied. One 
group of Ss received Murray’s instructions; 
one a set of instructions informing Ss they 
were about to take a test of intelligence; an- 
other a set of instructions informing Ss they 
were about to take a personality test; and a 
fourth group of Ss received neutral prelimi- 
nary instructions. 

Adequate interrater reliability for emotional 
tone and outcome was obtained. A difference 
due to examiners was found only for outcome 
ratings under the neutral condition. 

The Murray, personality, and intelligence 
instructions led to more depressive, sadder 
stories than did the neutral instructions. The 
implications of this finding with respect to 
TAT testings were discussed. It was concluded 
that neutral instructions might be the most 
appropriate kind of instructions to give Ss 
prior to taking the TAT. 


Received September 23, 1957, 
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Deviant Responses as Indicators of Immaturity 
and Schizophrenia 


S. O. Hesterly and Irwin A. Berg 


Louisiana State University 


When patterns of responses to various 
stimuli are examined, the responses often are 
biased and do not follow a normal probabil- 
ity distribution. Such “set” or einstellung phe- 
nomena tend to appear most clearly as the 
stimulus pattern is unstructured. There are 
myriad forms of such biased responses, such 
as the tendency to call “heads” on the first 
toss of a coin, the tendency to turn right when 
one may turn left or right, etc. (8, 14). In 
psychological tests, Cronbach (12, 13) has 
identified a large number of such biases and 
called them response sets. 

Since there is evidence that 
biases are expressions of personality traits G, 
3, 6, 11, 15, 19, 21, 22, 23, 24), Berg (5) 
sought to employ these patterns of bias as 
measures of personality but with only limited 
success. However, when attention was shifted 
from the pattern of bias to those responses 
which departed from the established set or 
bias, it was found possible to use these depar- 
tures as measures of personality and other 
characteristics. Barnes (2), for example, was 
able to construct a series of Clinical scales 
using this concept of deviant responses. Thus 
the key to the problem of utilizing response 
bias resides in using, not the pattern of bias 
itself but, rather, the responses which go 
counter to the established bias, i.e., the devi- 
ant responses. In other words, we should not 
pay particular 4 uy 
population who call “heads” when a coin 1s 
flipped, but we would closely scrutinize the 
20% who call “tails.” The latter response, 1n 
our lexicon, is deviant. A fuller account of the 
problem and its background is given in arti- 


cles by Berg (4; 5). ; 
The present study is one of a series of 


such sets or 


ttention to the 80% of the 


empirical tests of the Deviation Hypothesis 
which has been stated as follows: “Deviant 
response patterns tend to be general; hence 
those deviant behavior patterns which are 
significant for abnormality (atypicalness) and 
thus regarded as symptoms (earmarks or 
signs) are associated with other deviant re- 
sponse patterns which are in noncritical areas 
of behavior and which are not regarded as 
symptoms of personality aberration (nor as 
symptoms, signs, earmarks)” (5, p. 159). In 
other words, by using deviant responses in a 
noncritical area, such as a liking for designs 
we should be able to measure deviant be- 
havior in a critical area such as psychopa- 
thology, chronic organic disease, employee 
morale, creativeness, etc. 

The specific hypotheses of the present study 
were two: 

1. The response patterns of normal, young 
children to the Perceptual Reaction Test 
(PRT) (7) are significantly different from 
those of normal adults. As a corollary, older 
children have response patterns more similar 
to those of adults than younger children. 

2. The response patterns of normal, young 
children on the PRT more nearly approxi- 
mate those of adult schizophrenics than those 
of normal adults. 

Thus maturity as a critical area of behavior 
is assessed by means of deviant response pat- 
terns as they occur in the PRT. Then, since 
descriptions of schizophrenic behavior (9, 10, 
16, 17, 18, 20) typically make reference to 
immaturity as a common feature of the 
schizophrenic reaction, it is predicted that 
the deviant response patterns of normal, 
young children are similar to those found in 


schizophrenics. 
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Table 1 
Distribution of Subjects by Age, Sex, and 
Place of Residence 
nd 7-0 to 9-0 to 11-0 to 
ae 8-11 10-11 12-11 Totals 
Male 
Urban 25 25 25 75 
Rural 25 25 25 75 
Female 
Urban 25 25 25 75 
Rural 25 25 25 75 
Totals 100 100 100 300 
a 
Procedure 


In order to elicit deviant response pat- 
terns, the PRT was used. This test consists 
of 60 abstract designs drawn with ruler and 
compass. The subject is required to mark 
one of the following options for each design: 
like much (LM), like slightly (LS), dislike 
slightly (DS), or dislike much (DM). No 
obvious meaning is inherent in a 
designs; hence, 


group and assigning minus weights to PRT responses 
which were characteristic of 


sum of these weights was the schizophrenic score, 
These scores were compared 


place of residence by analysis of variance. The re- 
sulting variances for the 
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to be rather heterogeneous; therefore, Bartlett’s test 
for homogeneity of variance was applied to the data. 
Since all of the resulting chi-square values were sta- 
tistically significant beyond the .01 level of prob- 
ability, a nonparametric technique was used to com- 
pare the group schizophrenia scores, Specifically, the 
nonparametric median test seemed to apply to data 
of the type obtained, as it is not dependent upon 
homogeneity of variance. The hypothesis tested is 
that the groups compared are random samples from 
a population with a common median. 


Results 


Median schizophrenia scores on the PRT 
are given for all Ss in Table 2. The results of 
the nonparametric median tests for male Ss 


ble 3. The first comparisons 
are between normal, male children and nor- 


tween normal, male children an 
adult males. The obtained chi-square value of 


Table 2 


Median Schizophrenia Scores on the PRT fi 
Normal Children, 850 Normal Adults, ie 
Schizophrenic Adults Taken Separately 
and as Combined for Nonpara- 
metric Median Tests 


Median Score 


Combined 
Combined with 
- with schizo- 
; roup normal phrenic 
Subjects only adults adults 
Normal children 
Males (V=150) + 8.5 
50 ~141 5.80 
Females (W=150) 4 3.25 aao $336 
Normal adultsa 
Males (V=500) -17 
Females (W=350) _ 19°83 
Schizophrenic adults 
Males (N=99) +1 
40 
Females (V=68) + 3.50 


The data for 


from Bart an normal adults and schizophrenic adults are 


N 


at 
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Table 3 
Nonparametric Median Test for PRT Schizophrenia Score Differences Between Groups of Male Subjects 


Number 
Below Above Subgroup Chi 
Subjects median median Total median square df p 
N i 150 8.51 
ormal children 10 140 + 8.50 138.14 1 o 
Normal adults 309 191 500 —17.83 
Normal children S 85 150 + 8.50 310 i S06 
Adult schizophrenics 55 44 99 + 140 
Normal children 
7-10 to 8-11 years 17 33 50 +16.50 
9-0 to 10-1 youre 27 23 50 + 5.50 7.10 2 <.05 
11-0 to 12-11 years 31 19 50 + 2.50 
Normal children 
33 42 75 +12.00 
Urban 2 33 73 + 3.25 1.71 1 >.05 


3.10 is not statistically significant, supporting 
the null hypothesis that the two groups are 
probably samples from a population with a 
common median. Next, a comparison was 
made between three age groups (7-0 to 8-11 
years, 9-0 to 10-11 years, 11-0 to 12-11 
years) of normal children to determine the 
possibility of a significant trend in PRT 


schizophrenia scores as a function of chrono- 
logical age. The resultant chi-square value of 
7.10, which is statistically significant at the 
.05 level of probability, supports the hypothe- 
sis that the schizophrenia scores of normal 
children decrease significantly with age. The 
final comparison was made between groups of 
normal, urban and rural, male children. The 


Table 4 


Nonparametric Me 


dian Test for PRT Schizophrenia Score Differences Between Groups of Female Subjects 


Number 
——$——$——— 
Below Above Subgroup Chi 
Normal children 29 121 150 + 3:25 ao i age, 
Normal adults 223 127 350 —12.81 
150 + 3.25 
Normal children 76 s E T : nm 
Adult schizophrenics 34 
Normal children 
7-0 to 3-11 years 18 32 50 +11.50 Ta i 
9-0 > 10-11 ee 26 24 2 + ne . <.05 
11-0 to 12-11 years 32 18 
Normal children 
33 42 75 + 6.75 2.16 A ie 
Urban B 32 a He 
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obtained chi-square value of 1.71, which is a 
statistically significant, supports the null i 
pothesis that the two groups appear d e 
‘samples drawn from a population with a 
` n median. 
Table 4 presents the results of the non- 
parametric median tests performed to com- 
pare the median differences in scores for the 
Barnes schizophrenia scale obtained on the 
PRT between groups of female Ss. The com- 
parisons made between groups of female Ss 
were the same as those for male Ss. Although 
the chi-square values varied somewhat, the 
probability levels obtained were identical with 
those obtained for male Ss. Thus, the conclu- 
sions reached regarding females were the same 
as those for males. 


Discussion 


The results of the present study support 
the hypothesis, as stated earlier, that the re- 
sponse patterns of normal, young children to 
the PRT are significantly different from those 
of normal adults. Thei 


) approach the normal adult patterns for the 


may be used to assess 
maturity, insofar as the evidence of the pres- 
ent study indicates, 
Since normal children make responses to 
the stimulus patterns of the PRT that are 
not significantly different from those of adult 
schizophrenics, it may be inferred that some 
common factor or factors exist between the 
two groups. As noted earlier, immaturity of 
behavior has frequently been used as a phrase 
characterizing schizophrenics, The results of 
this investigation support this description, at 
least insofar as similarity of Performance on 
the PRT of normal children and adult schizo- 
phrenics is concerned, F urther, since the 
schizophrenia scores of normal children de- 
crease significantly with age, gradually ap- 
proaching the normal adult level, the schizo- 
phrenia scale could be used as a crude meas- 
ure of maturity. In fact, there is every reason 
to believe that with further investigation, us- 
ing wider age ranges and larger age samples, 
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a reasonably precise measure of maturity 
could be developed. ; 
As urban and rural children were not sig- 
nificantly different with reference to schizo- 
phrenia scores on the PRT, it would prob- 
ably be unnecessary to develop separate 
norms. It should be noted, however, that the 
actual differences in median scores for the 
two groups, although not statistically signifi- 
cant, were in the same direction for both 
males and females. Urban children scored 
slightly higher than rural children. This dif- 
ference might Possibly be found to be sig- 
nificant for larger groups of children. 


Summary 


dren and schizophrenic adults, 
characterized by immaturity of 
determine whether they might 
Groups of normal children were Compared, 
separately, with groups of normal adults and 
schizophrenic adults. Significant differences 
were found between the response 


not differ Significantly, 
A significant ¢ 
normal children 


ent. Thus, it was 
terns on the PRT 


Toups. Finally, the deviant 
S of normal children were 
Cut that they could be used 
ty, 
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Signs of Homosexuality in Human-Figure Drawings’ 


Armin Grams 


DePaul Universit y2 


and Lawrence Rinder 
Illinois State Training School for Boys? 


This study investigates the validity of the 
15 signs in human-figure drawing which 
Machover (1) lists as predictive of homo- 
sexuality. Fifty adolescent inmates of a State 
training school were divided on the basis 
of homosexual experience into two groups 
matched for age, schooling, IQ, and race. 
Each subject was asked first to draw a per- 
son and then to draw a person of the sex op- 
posite that of the first drawn figure. Three 
psychologists rated the drawings for the pres- 
ence of signs purported to be indicative of 


itate rating, Mach- 
jectively as follows: 


. Ear large or heavily lined or much detail 

- Detectable delineation of hips or buttocks 
Failure to complete drawing below waist 

Heavy line of demarcation at waist 

- Failure to draw “y” of crotch 

. Presence of shading on lips 

. Pants transparent (legs showing through) 

- Naked presence of Sexual organs (genitals only) 

. Trousers only clothing shaded 

10. Female figure transparent below waist 


OON ANRHYDN HE 


1An extended report of this study may be ob- 
tained without charge from Armin Grams, Institute 
of Child Development and Welfare, Minneapolis 14, 
Minnesota, or for a fee from the American Docu- 
mentation Institute. Order Document No, 5691 from 
ADI Auxiliary Publications Project, Photoduplica- 
tion Service, Library of Congress, Washington 25, 
D. C., remitting in advance $1.25 for microfilm or 
$1.25 for photocopies. 

?Now at Institute of Child D 
Welfare, University of Minnesota. 

3 Now at Blackhawk Mental Health Center, Water- 
loo, Iowa. 


evelopment and 


11. Male nose large, erased, and redrawn 


12. Phallic foot (length at least three times width 
and/or shaded tip) 


13. Belt shaded and speared to right of figure 
14. Presence of eye lashes 


15. Drawing of female figure first 


The extent to which all judges rated a sign 
present or absent in a drawing became the 
index of rating reliability, Agreement on the 
drawings of homosexuals was 76.5%, on the 
drawings of Controls, 83.1%. 

Three of the signs 


squares whose P values were b 


ctive significance of the 15 
the total number of 


Reference 


> Ten. Perso 
drawing of the h 
Charles C Thom: 


nality projection in the 
uman figure. Springfield, IIl.: 
as, 1949, 
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An Evaluation of Human-Figure Drawing 
Indicators of Paranoid Pathology 


Marvin Reznikoff and Alma L. Nicholas 


Institute of Living, Hartford, Connecticut 


The drawing of human figures is a technique 
which has proved to be of considerable useful- 
ness in the personality evaluation and diag- 
nosis of psychiatric patients. Interpretations 
of figure drawings, however, are based more 
often on clinical intuition and experience than 
on objectively defined or validated criteria. 
As Holzberg and Wexler (1) point out, in 
their validation study of figure drawings, this 
technique remains «much more of an art than 


a science.” : 

Despite efforts to validate figure drawings, 
disagreement concerning the significance of 
certain characteristics of the drawings still 
exists. Clearly contradictory are some of 
the findings relating to paranoid indicators. 
Machover (2) includes, as possible indicators 
of paranoid traits, eye emphasis, ear emphasis, 
large figure placed in the middle of the page, 
a large head, and speared or talon-like fingers. 
In a recently published study, Ribler (3) in- 
vestigated two of these indicators, eye and ear 
emphasis, in paranoid schizophrenics com- 
pared with unclassified schizophrenics, anxiety 
neurotics, and “normals.” He found no sta- 
tistically significant differences between the 


diagnostic groups with regard to these two 


variables. 

In endeavoring to int 
results it is worth noti 
solely upon diagnostic ca’ S 
his Sian as paranoid or nonparanoid. He 
did not attempt a direct estimation of the 
paranoid component in a patient’s pathology. 
The intent of the current study was to check 
some of the drawing features reported as 


paranoid indicators in a group of pitia 
specifically evaluated for the presence a 
extent of paranoid symptomatology. 


erpret these discrepant 
ng that Ribler relied 
tegories in classifying 


Procedure 


Subjects 


In selecting the subjects for this study, a 
number of staff psychiatrists and experienced 
psychiatric residents at the Institute of Living 
were asked to indicate any of their presently 
hospitalized patients who had a history of 
paranoid behavior and were currently para- 
noid. They were also asked for a list of pa- 
tients who had no history of paranoid behavior 
and currently evidenced no paranoid ideation. 
When a patient was classified as paranoid, the 
psychiatrist was requested to rate the degree 
of paranoid involvement as “mild,” “moder- 
ate,” or “marked.” The following definition 
of paranoid trends, adopted in a modified form 
from the Diagnostic and Statistical Manual 
of Mental Disorders prepared by the Ameri- 
can Psychiatric Association, was used as a 
guide by the psychiatrists in categorizing their 
patients: 


Thinking characterized by the use of projection as a 
defense mechanism. Behavioral manifestations are 
suspiciousness, envy, extreme jealousy and stubborn- 
ness. In more flagrant cases, ideas of reference and 
delusions of persecution and/or grandeur are evident. 


All patients who were under 15 or over 60, 
of below average intelligence, or having any 
type of organic involvement were excluded 
from the study. The actual sample consisted 
of 61 hospitalized patients, 31 described as 
paranoid and 30 as nonparanoid. The mean 
ages of the paranoid and nonparanoid groups 
were 31.8 and 31.5 years respectively. Both 
groups contained patients having neurotic and 
psychotic diagnoses. In the paranoid group, 12 
patients were judged to be “mildly paranoid,” 
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9 “moderately paranoid,” and 10 “markedly 
. » 
EA of both a male and female figure 
were already available on a number of eg 
patients who had been referred for penne 
psychological testing prior to this study. T e 
status of these patients at the time of i ing 
was obtained from their physicians. oe re- 
maining patients, who had not Beles re- 
ceived tests, were individually asked to draw 
human figures. 


Scoring Procedure 


A list of 26 carefully defined characteristics 
of figure drawings, which might discriminate 
paranoid from nonparanoid patients, was com- 
piled from Machover’s indicators, the authors’ 
clinical experience, and relevant items taken 
from the check list used by Holzberg and 
Wexler. These items are as follows: 


1. Careful detailing of eyelashes 

2. Careful detailing of eyebrows 

3. Line emphasis on outline of the eyes (rein- 

forcement) 

4. Shading of the eyes 
5. Two eyes in profile view 

6. Eyes represented by circles 

7. Eyes represented by crosses 

8. Eyes represented by dots 

9. Eyes represented by dashes or curves 
10. Unseeing eyes; eyes without a pupil 


13. Disproportionately large ears 


14. Line emphasis on outline of ears (reinforce- 
ment) 

15. Ears where None should be Present 

16. Shading of the ears 

17. Ear misplaced in 

18. Ears absent 

19. Unusual articulat; 

20. Dark or heavy li 


relation to other head features 


ion and/or detailing of ear 
e emphasis overall 


ures of line; light and heavy 
pressures 


22. Shading of areas other than e; 
23. Speared or talon-like fingers 
24, Disproportionately large head 
25. Clothing elaborations to conceal some features 

of the figure (cloak, Cape, any unusual clothing) 
26. Size of figure (actual length measurement) 


With all 61 sets of drawings randomized 
and any information relating to group clas- 
sification removed, the drawings were scored 
independently by each of the authors. A plus- 
minus scoring system was used to indicate the 
presence or absence of the first 25 of the in- 


yes and ears 
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dicators in a patient’s set of two drawings. 
For Item 26, an actual Measurement of the 
first figure drawn was used, X 
There was 93% agreement between the in- 
dependent ratings of the two judges. Differ- 
ences in scoring were reviewed, and agreement 


was reached with regard to the appropriate 
score. 


Treatment of Data 


The number of times each of the first 25 
indicators occurred in the two groups was 
tabulated, and comparisons between the groups 
were made using chi square. A ¢ test was em- 
Ployed to determine whether the paranoid 


patients differed significantly from the non- 
Paranoids in the 


and “markedly Paranoid” 
an analysis of variance des 
test for differences between 


Results and Discussion 


Of the 25 indicators only 2 
on outline of eyes (Item 3) 
emphasis overal] (Item 20), 
nificantly more frequently in 


group. The chi Square value of 6.32 for the 
eye emphasis item is sion; 
For over-all lin 


, line emphasis 
and heavy line 
occurred sig- 


Figure Drawings and Paranoid Pathology 


reveals that paranoids do not typically draw 
larger figures than other patients. 

In a further analysis of the data it was 
found that the paranoids did not differ sub- 
stantially from the nonparanoids in the num- 
ber of indicators occurring in their individual 
drawings. The mean number of indicators 
present in the drawings of the paranoid group 
was 4.97, while the mean for the nonparanoid 
patients’ drawing was 4.23. The # test in this 
instance yielded a nonsignificant value of 1.45. 

A final procedure entailed comparing the 
drawings of three subgroups of paranoid pa- 
tients categorized according to severity of 
paranoid symptomatology. The differences be- 
tween the patients in these groups in the num- 
ber of indicators appearing in their drawings 


(drawing scores) were not statistically sig- 


nificant (F = .24). The mean numbers of in- 
dicators in the three groups were 5.00, 4.41, 
and 5,40 for the “mildly,” “moderately,” and 
“markedly” paranoid patients, respectively. 


Summary 


An attempt was made to check the useful- 
ness of 26 drawing indicators in determining 
paranoid pathology. Figure drawings were ae 
lected from 61 hospitalized patients of varie 
diagnostic categories, evaluated specifically 
for paranoid symptomatology. Comparisons 
were then made between the figure drawings 
of 31 patients in this group classified as para- 
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noid and the remaining 30 patients judged 
entirely free of paranoid characteristics. 

Of 25 indicators, emphasis on the outline of 
the eyes and over-all heavy line emphasis oc- 
curred significantly more frequently in the 
paranoid group. It should be noted, however, 
that two significant findings in 25 statistical 
tests could easily be obtained on the basis of 
chance. The size of the figures did not differ- 
entiate between the groups. When the patients 
were compared with regard to their drawing 
scores, that is, the number of indicators pres- 
ent in their individual drawings, the groups 
again did not differ significantly. Nonsignifi- 
cant results were also obtained in a compari- 
son of the drawing scores of the “mildly,” 
“moderately,” and “markedly” paranoid pa- 
tients. 
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Causative Factors in the Production of Rotations 
on the Bendet-Gestalt Designs 


Lewis D. Hannah 
Athens State Hospital 


Many studies of performance on the Bender- comparable 
Gestalt Visual Motor Test (1) have been rotat s 
made recently. There are 50 direct references them with thi 


» Were made 

tortions in reproductions are made. It seems of material similar to the old cards. The design 

that if more of the workings of mental mecha- was made to be the Same size as on the old 

nisms tending to cause distortions were known, cards. The length of the horizontal edges of 

the test could be used in a more realistic and the cards was also the Same as the old cards, 

meaningful way, However, the vertical edges were extended to 
The present study is an attempt to show a length which made the 


that factors other than m dge to the vertical edge the 

Same as the ratio of the 84” side to the 11” 
Signs are reproduced. It is believed that the Side of a Standard sheet of Paper. Sixty con- 
demonstration of even one way of artificially i issi 


in the reproduc- 


late with behay- periment, 


est has suggested The two groups were 
diagnosis, age, sex, etc, 
noses it was Possible to s 
One group for which a ma. 
found in the Other group. 
The BG test as commonly used today has 36 each Were then comp; É 
the designs printed on a card that is Oriented for difference in age and 
horizontally. That is, the top and bottom nificantly different, Ther 
edges of the card are longer than the edges on 29 females in the first group, while there were 
either side. These designs are then Copied on 12 males and 24 females in the second group. 
paper with horizontal edges which are much After the records 
shorter than the. vertical edges. Because of 


Were selected they were 
5 then scored for rotations. For this study, a 
this, a subject must rotate the reproduction 90 


A . àS scored only if the reproduction 
degrees in order to preserve the orientation of was clear] : 
the design on the card, If this is true, then 


then Compared for 


Could be expected to į 


dentify which stimulus 
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Production of Rotations on the Bender-Gestalt 


card it was copied from—and if it was clearly 
rotated at least 45 degrees. Each record was 
then given a score which was equal to the 
number of designs rotated on the record. Thus 
the minimum possible score was zero and the 
maximum possible score was eight. The scores 
of the records produced by those subjects 
Presented the old cards were then compared 
with the scores earned by those who had the 
designs presented on the new cards. 


Results 


In Group I, those who had copied the de- 
signs from the new cards, eight rotations were 
Produced. The average score for the group was 
.222. The highest score earned was one. 

In Group II, the highest score earned was 
five and the lowest zero. Rotations were found 
on eight of the records, and the average num- 


ber of rotations for the group was .639. 
Comparison of the scores earned was made 


by use of Student’s ¢ and it was found that the 
Probability of the differences in number of 
rotations produced by the two groups being 
due to chance alone was less than 01. 


Discussion 


It is felt that the BG test is a valuable aid 
in diagnosis but that too often its limitations 
are not kept in mind when making interpreta- 
tions. Though too little is known about per- 
ceptual mechanisms to explain satisfactorily 
all “abnormalities” produced by subjects asked 
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to copy the BG designs, this study has demon- 
strated one way that “abnormalities” are pro- 
duced as a function of the way the stimulus 
design is oriented on the card on which it is 
presented. It is believed that the use of the 
“new” cards described in this report will 
eliminate the number of false positives called 
by the BG. What, in terms of diagnosis or 
behavior correlates, the positives are, still re- 
mains to be established, and interpretations 
must still be made almost entirely on the 
basis of personal experience with the test. 


Summary 


It is believed that factors other than organic 
or functional impairment of mental function- 
ing will produce rotations in reproductions of 
the BG cards. To test this, two groups matched 
for age, sex, and psychological diagnosis were 
given the BG test. The stimulus cards for the 
two groups were different in that designs on 
one were printed with the card oriented hori- 
zontally, while for the other test the cards 
were oriented vertically. The group which was 
presented the vertical cards produced fewer 
rotations than the control group which was 
presented standard BG cards. The results were 
significant at the .01 level of confidence. 


Received September 9, 1957. 
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Sex Differences on the Rorschach! 


E. Earl Baughman and Samuel Guskin 


University of North Carolina 


The data to be summarized were gathered 
as part of a larger study concerned with the 
role of stimulus attributes in determining Ror- 
schach responses. It was in relation to this 
larger project that the problem of sex differ- 
ences arose, since it was not possible to ob- 
tain equal numbers of males and females for 
the study. Numerous investigations in the 
literature pose an interpretive problem in this 
regard, although usually the problem tends to 
be ignored. 

Rorschach (9) anticipated that males and 
females as groups would respond differentially 
to inkblots even though it was not possible to 
determine the subject’s (S’s) sex from the 
record of the test. Standard references (2, 3, 
6, 7, 8, 10, 11) devote little or no attention 
to this question, however, despite the fact that 
it is an elementary one in test construction 
theory. The few empirical studies that have 
been completed are limited to children and 
adolescents as Ss (1, 5, 12). If sex differences 
do exist, one might expect these differences to 
show up most clearly in the records of adults. 
The reason for this is the fact that constitu- 
tional differences may be reinforced through 
cultural learning, producing more clear-cut 
separation of the sexes as development pro- 
ceeds.” 


Procedure and Results 


Two examiners (one male, one female) 
tested a total of 162 Ss (29 males) following 


1This research is part of a larger project sup- 
ported by Grant M-1027 from the National Insti- 
tute of Mental Health, U. S. Public Health Service. 
We wish to thank Hans Grainer and Patricia M. 
Fossum for administering the tests. Frances Alex- 
ander and Paul Fiddleman assisted with the calcu- 
lations. , 

2 Jt is possible that learning effects may reduce sex 
differences in a given culture, but in western culture 
this is not usually held to be the typical outcome of 


training. 


Beck’s (3) procedure. Twenty-six males were 
then selected for whom close matches could 
be found in the female group as far as the 
variables of age and intelligence were con- 
cerned. Matching selections were carried out 
by a person unacquainted with the Rorschach 
protocols. Selections were also made so that 
each examiner tested equivalent numbers of 
males and females. All Ss were home-office 
employees of two insurance companies in a 
southern city.* The ages of the Ss ranged be- 
tween 23-50 (x= 33 years); Otis IQ scores 
ranged between 95-135 (x= 111). In this 
way two groups of 26 Ss (one male, one fe- 
male) were composed which were closely 
matched on age, intelligence, and place of 
employment. It was not Possible, however, to 
equate the groups on education, more college 
males than college females being included in 
the samples. 

The significance of differences between the 
two groups on 17 summary scores (R, W, D, 
Dd, S, M, FM, m, 3M, FM, and m, F + %, 
T/1R, T/R, Total Time, 8-10/R%, Number 
of Content Categories, A%, and P) was then 
evaluated by means of chi square.* Only one 
score, FM, revealed a significant difference 
between the sexes at the .05 level, male Ss 
giving more animal movement responses than 
female Ss. ) 

In order to check on the stability of this 
one positive finding, two additional samples 
of 21 males and 21 females were drawn from 
a group of 81 Ss who had responded to an 


ê The authors are indebted to the Jefferson Stand- 
ard Life Insurance Co. and the Pilot Life Insurance 
Co. for their generous contribution of employee time 
and testing facilities, 

*The markedly skewed nature of most distribu- 
tions of Rorschach scores makes chi square a pre- 
ferred technique for analysis. The relative insens!- 
tivity of chi Square, unless samples are large, nee 
to be recognized however. : 
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achromatic series of Rorschach blots. Al- 
though devoid of color, previous analyses of 
the data had shown that the frequency of FM 
Tesponses was not affected by the presence 
or absence of color. These two groups were 
matched on the productivity (R) variable 
since precise matching on the other variables 
previously used for this purpose was not fea- 
sible. Analysis of the frequency distributions 
of FM responses by chi square failed to con- 
firm the earlier finding ($ > -30). 


Discussion 


One other statistical study of Rorschach 
sex differences has been reported recently. 
Felzer (4) checked 26 variables, finding two 
sgnificant differences, T/R and FC. In his 
samples of college students, males took more 
time per response, and they also gave fewer 
FC. responses. The females in the present 
study, in contrast, took longer for each re- 
sponse, although the difference did not reach 
a statistically significant level. The data do 
not provide a good check on the color (also 
shading) variable, since an experimental in- 
quiry procedure was used which renders the 
data noncomparable; hence, tests for these 


_.y/ scores have not been reported and Felzer’s 
e FC variable must be 
it 


tween adult males and females can be demon- 
strated; an occasional significant difference in 
one study is not likely to be confirmed by a 
subsequent study. 
There is a broader 
dure involved in t 1 
P ceris the relationship between theories 
and the instruments used to 
assess personality. Most dynamic theories of 
personality point out real differences vate 
males and females, related to their kath if- 
ferent constitutional endowments, as nl T 
the different types of subsequent critica. a 
} velopmental experiences which they | must 
typically confront. If theory 1S correct in thi 
regard, then one should expect the Card 
tional properties and dynamics of per on” ity 
to be distinguishably different in a E a 
females. It does not appear psychologically 


d findings regarding th 
checked by later work. The data from both 
studies, however, suggest the improbability 
that stable differences in summary scores be- 
issue than Rorschach 
he present discussion; 


of personality 


Sex Differences on the Rorschach 
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sound, therefore, to construct personality 
tests so as to equate the sexes; nor can a 
given technique, such as the Rorschach, be 


defended as sufficiently adequate if sex dif- 
ferences cannot be demonstrated. 


Summary 


Groups of males and females (N = 52) 
were matched for age and intelligence. Ror- 
schach summary scores for the two groups 
were compared in order to determine if sex 
differences existed; no stable differences were 
found. A larger question of the relationship 
between personality theory and sex differences 
as related to assessment devices was also dis- 
cussed. The proposition was defended that 
sensitive personality devices should reflect 
sex differences. 


Received August 23, 1957. 
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Doctrine.and Experience: Their Influence 
Upon the Psychotherapist 


William F. Fey 


Department of Psychiatry, University of Wisconsin 


The parameters of the psychotherapeutic 
experience have proved difficult to isolate and 
quantify. Admitted differences among thera- 
pists’ behaviors are known to be great (2, 3, 
4, 5, 6, 7, 8, 9), and actual differences are 


doubtless still greater. The most obvious ques- 


tion about psychotherapy—“What happens 
least equipped 


during the hour?”—we are 
with facts to answer. Transcripts of therapy 
lack the nuances of sound and feeling; re- 
corded tapes neglect important visual clues. 
Motion pictures require elaborate, unnatural 
technical settings and are virtually nonexist- 
ent; and a panel of qualified but unbiased ob- 
servers is difficult even to conceive. Moreover, 
knowledge that the process is being observed 
or recorded at all is said to inhibit and trans- 
mute the experience. The principals them- 
selves, patient and therapist, are least objec- 
tive of all, for their reports, while firsthand, 
are inextricably colored by the powerful com- 
plex of needs which has produced and sus- 
tains their highly unique relationship. 

Any simple report of what happens be- 
d therapist omits fundamen- 
n since, for example, one’s man- 
ner in refusing & gift is probably more impor- 
tant in the treatment process than is the fact 
of refusing it. But the fact and manner are 
not unrelated, and the patterning of facts 
ascribable to a therapist doubtless reflects 
something of his manner and his basic atti- 
tudes toward patients. Therefore, despite their 
obvious limitation as primary data, the pres- 
ent study is based upon therapists’ reports of 
their responses to patients. The assumptions 
are made that however subtle and refined the 
underlying rationale of therapeutic strategy 


tal informatio 


may be, it must eventually be given expres- 
sion in behavior, and that intensive scrutiny 
of such behavior will afford glimpses of basic 
therapeutic philosophy. For the present study. 
then, the working null hypotheses are these: 
that differences in doctrine and experience 
among therapists are unrelated both to their 
direct reports of behavior with patients and 
to the underlying attitudes which the pattern- 
ing of these behaviors might suggest. 


Method 


A simple questionnaire composed of issues 
commonly arising in the conduct of psycho- 
therapy was sent to each person in a mid- 
western university city who was known to be 
conducting consecutive interview treatment. 
The questionnaire items appear in Table 1. 
For the first 27 items, the scale of answers 
ranged from 1 (“yes” or “always” or “rou- 
tinely”) through 5 (“no” or “never”). The 
final two items summarize the respondents’ 
tendencies in marking the questionnaire items 
themselves. 

The 36 therapists polled included 29 psy- 
chiatrists (18 of whom were board-certified) , 
5 psychologists, and 2 psychiatric social work- 
ers. Of these, 34 (94%) responded, one re- 
plied to decline participation, and one failed 
to reply. Each identified his protocol only by 
stating the number of years he had been do- 
ing therapy and by indicating what theoreti- 
cal orientation, if any, he tended to observe. 
Doctrine and profession were known to be 
independent in this sample; the Rogerian 
group, for example, is not predominantly psy- 
chologists. These identifying variables are 
summarized in Table 2. 
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Table 1 


Questionnaire Items 


1. Do you obtain from the patient a detailed case 
history before beginning psychotherapy (interview 
therapy)? , . 

2. Wee accept a small gift from a patient in 

chotherapy? as 

3: Would the ae of the gift influence your decision? 

4. Ordinarily, do you answer general questions of fact 
such as, “Are psychiatrists always doctors?” 

5. As therapist, do you ask your patient questions? 

6. Assuming you were licensed, would you write (e.g., 
sedative) prescriptions for your patient? 

7. Do you interview the relatives or friends of a pa- 
tient, whom you’ve decided to see in psychotherapy, 
for the purpose of obtaining more complete knowl- 
edge about the patient? X 

8. Do you ask the patient for dream materials? 

9. Do you contact a patient who fails to appear or to 
notify you on two consecutive appointments? 

10. Would you ever go to the patient’s home to do 

psychotherapy? , 

11. Do you make any efforts to ease the environmental 
stress upon your patient by contacting significant 
persons in his life? 

12. Ordinarily, do you answer personal questions of 
fact from the patient such as, “Are you Catholic?” 
or “Are you married?” 

13. Are you willing (if you have the time) to discuss 
nonemergency issues with your patient on the tele- 
phone? 

14. Do you deliberately assume different therapeutic 
roles with different patients? 

15. Do you try to maintain the same therapeutic role 
throughout the entire course of therapy with a 
given patient? 


16. Ordinarily, do you answer personal questions of 
opinion such as, “Do you enjoy classical music?” 

17. In the course of therapy your patient decides to 
make an unpromising marriage. Would you make 
your doubts about it known to him? 

18. Would you deliberately avoid being in a social 
situation with your patient? 

19. If your patient asked you to talk with her husband 
about her condition, would you be willing? 

20. Typically, do you “interpret” your patient’s be- 
havior, in the sense of showing him its real signifi- 
cance—meanings of which he is unaware? 

21. Assuming that you have open hours, do you offer 
your patient a choice concerning the number of 
interviews per week? 

22. Do you or would you employ hypnosis or drug 
Preparations to aid your patient in producing mate- 
rial for psychotherapy? 

23. Do you extend, beyond the usual time limits, an 
interview which is proving unusually productive? 

24. Do you feel it is important not to “personalize” 
your office with photos, knicknacks, etc.? 

25. If a regular patient, not in emergency, phones to 
Tequest an extra, unscheduled interview, do you 
grant it? 

26. Do you attempt to maintain a definite and con- 
sistent length of interview? 

27. Ordinarily, would you reply frankly to your pa- 
tient’s question, “Do you think this (therapy) is 
helping me so far?” 

28. How many years have you been doing therapy? 

29. The number of midline or “3” answers to the items. 

30. The number of extreme or “1” and “5” answers to 
the items. 


Results 


Although the sample of respondents well 
represents a particular locale, serious prob- 
lems in interpretation arise in that the sam- 
ple contains no very experienced Rogerians, 
and the Analytic group is both small and di- 
verse in range of experience. To facilitate the 
test of hypotheses, the total sample was di- 
vided into the following four groups: Roger- 
ians (V = 7), Analysts (NV = 5), Young Ec- 
lectics (those 8 therapists with fewer than 10 
years’ experience), and Older Eclectics (the 
remaining 14 eclectics with 10 or more years? 
experience). z 
The data were first examined with re- 
spect to homogeneity within doctrines, testing 
the expectation that, for example, Rogerians 
should answer the items more like other Ro- 


Table 2 
Respondents Grouped by Doctrine and Experience 


Years of Doctrines 
experi- Se 
ence Rogerian Analytic Eclectic Totals 
1-3 5 2 2 9 
46 2 1 4 7 
7-9 — = 2 2 
10-12 Ai ahd 4 
13-15 - = 1 mh 5 
16-18 — = T5 0 
19-21 as 1 3 4 
22-24 E £ 3 3 
Totals 7 5 22 34 
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Table 3 
Correlations of Each Therapist with the Model or Average of Each Group™ 
Model 
Thera: odels T Models 
pist Rog. Ana. YEc. OEc. pist Rog. Ana. YEc. OEc. 
Rog. 1 +74 +41 +39 —25 OEc. 2 —21 +23 +03 +48 
2 +78 +33 +24 —30 4 —65 +08 +04 +54 
3 +82 +30 +24 —42 5 —04 +37 +31 +42 
4 +56 +42 +52 —19 6 —32 +07 +32 +80 
5 +91 +22 +27 —28 7 —11 +30 +58 +40 
6 +72 +18 +04 —16 8 +06 +18 +25 +22 
7 495 +26 +231 -48 9 +22 +31 +35 +31 
12 —26 +03 +24 +59 
YEc. 1 +28 +13 +32 +09 10 —42 +08 +36 +80 
3 —06 +22 +28 +41 13 —49 —20 —17 +43 
11 +02 +62 +56 +58 14 —05 +30, +44 4:52 
16 +48 +37 +42 +03 15 —08 +17 +34 +53 
18 —19 +23 +33 +75 17 —27 —20 +16 +46 
19 Tas +36 +34 —09 22 —18 +34 +52 +71 
20 Teon Ay. Fa = 
21 441 +41 +32 +67 Ana. 1 =25 +27 ese 4-24 
2 +26 +59 +54 +13 
3 +04 +25 +38 +27 
4 +70 —12 +04 —41 
5 +11 +18 +54 +35 
a When df = 27,7 5 37, p <.0557 5 ATP <o 
group to the entire questionnaire. It thus be- 


ctics. An informal meas- 


ure of such homogeneity is to be found in the 
correlation of each therapist’s answers, item 
by item, with the average response of his own 
group—himself excluded. These values appeat 
in Table 3, where even a casual inspection 

Rogerians are most homo- 


would suggest that 1 
geneous, the Analysts least. The correlations 
of Rogerians with their own average have a 
mean of +.79, Analysts with their average 
+ .25, Young Eclectics + .36, and Older Ec- 
lectics + .54. 

Each of the four groups has an average re- 
sponse to each item which, when collated, 


offers a kind of “model” response for that 


gerians than like Ecle 


Table 4 
Correlations Among Group Average Responses * 
Young 
Group Rogerian Analytic Eclectic 
Analytic +.36 
Young Eclecti -.30 +.68 
oung Eclectic tZ SE iets 


p <0. 


a When df = 27,7 5 37, P <.05;7 5 Ah 


comes possible to compare each therapist with 
the models of the doctrines he does not claim 
to represent. These correlations, which also 
appear in Table 3, further clarify how each 
therapist relates to the several doctrines ex- 
amined. Finally, these models may themselves 
be correlated to produce the figures shown in 
Table 4, in which it appears that the Ana- 
lysts and Young Eclectics are most similar as 
groups in their replies to the items, whereas 
Older Eclectics and Rogerians are least alike. 

Next, a mean score for each group on each 
item was computed, and these sets of means 
subjected to separate F tests. The data ap- 
pear in Table 5, which includes as well the 
within groups variance (df = 30) for readers 
who may wish to test a private hypothesis re- 
garding item differences. Sharp discrepancies 
among the group means are clearly present, 
permitting rejection of the first general hy- 
pothesis—that differences in doctrine and ex- 
perience among psychotherapists are unre- 
lated to their direct reports of behavior with 


patients. 


Finally, as an approach to answering the 
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Table 5 
Differences Among Group Means on Questionnaire Items 
Group Rog. Ana. YEc. OEc. Group Rog. Ana. YEc. OEc. 
N 7 5 8 14 Ow 52 N 7 5 8 14 owt $ 
Items 
I 
aa 3.6 24 2.4 21 2.13 — 16 4.7 3.4 3.4 2.0 0.67 01 
2 3.4 2.0 2.1 2.8 2.53 — 17 4.9 3.4 3.0 2.4 1.83 01 
3 3.4 1.8 2.2 3.6 2.96 a 18 4.0 3.0 2.8 2.5 2.33 = 
4 2.9 24 2.0 1.3 0.93 .05 19 4.1 2.4 1.4 11 0.60 01 
5 4.4 2.0 a2 21 1.60 01 20 4.6 3.6 3.2 2.8 1.03 01 
6 4.1 32 3.4 3.1 0.87 = 21 3.6 2.6 1.8 1.9 1,93 ae 
i 4.6 4.2 2.8 21 1.03 .01 22 4.6 4.6 4.0 33 0.70 01 
8 5.0 3.0 3.1 2.4 1.50 01 23 4.3 3.2 3.1 2.1 1.23 01 
9 2.3 3.2 2.9 tS 2.07 = 24 3:7 2.2 2.8 1.4 1.63 01 
10 49 38 46 42 183 å =| 25 3.0 3.2 29 24 1.67 05 
11 50 34 30 27 0.57 01| 26 50 50 50 38 1.10 05 
12 36 32 29 19 1.47 05 27 S0 36 34 21 2.33 01 
13 4.9 3.0 2.8 1.9 2.00 .01 28 4.7 4.0 4.4 2.6 1.00 OL 
14 4.0 3.0 2.8 25 3.67 = 29 43 3.6 3.4 3.4 1.20 = 
15 49 22 35 23 243 01| 30 21 36 35 24 130 — 


second general hypothesis, all 30 items of the 
questionnaire were intercorrelated, factored 
by the centroid method, and rotated to yield 
the oblique solution shown in Table 6.» 2 
The item communalities are reproduced in 
this table as evidence of the efficiency of the 
solution in accounting for the item variances. 

The four factors and those items contribut- 
ing most heavily to them may be regarded as 
empirically homogeneous yet fairly independ- 
ent scales in terms of which group differences, 
if present, might be expected to emerge. To 
examine this possibility, the purest items from 
each factor were grouped into scales and each 
therapist given a score on each scale. Scale I 
was composed of Items 9, 10, 18, and 30; 
Scale II of Items 1, 2, 4, 6, and 14; Scale III 
of Items 7, 11, 22, 26, and 27; and Scale IV 
of Items 5, 15, and 29. The relative independ- 
ence of these measures is shown by their in- 
tercorrelations in Table 7, and their sensitiv- 
ity to group differences appears in Table 8. 

The clearest test of the effects of doctrine 


1 The writer is grateful to Chester W. Harris of 
the University of Wisconsin for his counsel on this 
portion of the study. A 

2 A two-page table containing the original correla- 
tion matrix has been deposited with the American 
Documentation Institute. Order Document No. 5738 
remitting $1.25 for microfilm or $1.25 for photo- 


copies. 


is thought to be between the Rogerian and 
Young Eclectic groups, and that of the ef- 
fects of experience between the Young and 
Older Eclectics. Table 8 suggests that all four 
scales are sensitive to the variable, Doctrine, 
and that Scales III and IV are influenced by 
the variable, Experience. 


Discussion 


The homogeneity data sustain the impres- 
sion of Rogerian structure as being relatively 
well-defined and consistent from patient to 
patient. Unexpected, however, is the com- 
monality among this group of eclectics who, 
while avoiding doctrinaire alignments, appear 
independently to have defined a doctrine of 
their own. The low agreement among these 
analysts perhaps reflects mainly their small 
number and heterogeneous experience. 

Comparing individual therapists with their 
own and with foreign doctrines serves to em- 
phasize the range of behaviors within schools. 
For example, YEc. 20 and Ana. 4 align with 
the Rogerians: YEc. 18 and YEc. 21 with the 
Older Eclectics. Relatively pure partisans ap- 
pear, such as Rog. 6 and OEc. 4, as well 
as an eclectic’s eclectic (OEc. 9), who has 
roughly equal loadings in each doctrine. 

In choosing the basic groups for further 
analysis, one is tempted to adopt the func- 


Doctrine and Experience of Psychotherapists 


407 


Table 6 
Communalities and Item Loadings for Rotated Factorial Solution 
; Oblique factors 
ae a 
tem Item content h? I Ir m vv 
9 No contact after 2 misses 
a 2 292 = 
B Goes to patient’s home 314 = 3 n 
30 Does not avoid pt. socially 209 29 01 19 o 
Gives many dogmatic answers 552 —52 33 38 Ss 
1 Takes case history first 4i1 
a a —26 55 
2 Would accept small gift 417 08 57 3 E 
4 Answers, “Are psychiatrists . - = 785 —21 79 38 15 
6 Writes prescriptions 439 15 44 30 —01 
14 Diff. roles with diff. pts. 677 00 74 00 00 
21 Sets frequency of interviews 357 —31 39 32 37 
7 Interviews relatives 720 —11 43 
11 Eases environment 655 —03 34 He a 
22 Employs hypnosis and drugs 590 —08 34 66 10 
26 No fixed interview length 391 00 00 54 00 
27 Answers, “Is therapy helping” 661 —04 21 72 34 
25 Grants extra hour 320 02 14 54 05 
16 Answers, “Enjoy music - - P 737 —25 35 77 42 
24 Personalizes office 709 o -21 70 45 
23 Extends productive hour 702 —18 43 62 
46 
17 Warns of bad marriage 490 —02 20 58 34 
20 “Interprets” 571 37 12 40 08 
19 Would talk with spouse 720 17 20 49 47 
13 Talks on phone 538 —06 34 51 AL 
12 Answers, ‘You married?” 628 —13 49 62 16 
8 Asks for dreams 698 —08 45 66 22 
5 Asks questions ó 595 —16 30 35 61 
15 Diff. roles with same patient 494 23 —07 27 50 
29 Gives many midline answers 431 00 00 00 58 
28 Many years doing therapy 616 —24 13 63 63 


tional clusters suggested by the correlations 
d allegiances 


of Table 3, rather than the state! 
of Table 2. However, such a choice would 
jously maximize latent group differences 
to deny the fact of significant varia- 
tions among adherents of a particular school. 
The correlations among the four group 
models shown in Table 4 are thought to re- 
flect some historical developments. The dis- 


tinction between young and older eclectics 
As these data 


is more than one of years 
were gathered in 1953, this split corresponds 
roughly to the pre- and post-World War I 
training in psychiatry—@ period which saw, 
among other changes, a broader acceptance 
of modern psychodynamic principles. It thus 


spur 
and serve 


seem: 


s natural that the Young Eclectics should 


be closer to the Analysts (+ .68) than are the 
Older Eclectics (+ .20). 


Table 7 


Correlations Among Scales Based Upon 
Factor Analysis* 


Scal 


Scale 
Scale 
Scale 


Scale Scale Scale 
le I I tr 
IL +.10 
m —.00 = 50 
IV +.21 +.35 +.38 


a When df = 32,7 5 35, 


p <.05;r5 45, <01. 
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Table 8 
Group Means, F Test Probabilities, and Selected Comparisons Among the Factor Scales 
Group Means Differences 
Young Older Rog. vs. Yng. Ec. vs. 
Scale Rogerian Analytic Eclectic Eclectic $ Yng. Ec. Older Ec. 
7 7 <.05 NS 
6.43 12.00 13.00 14.78 <.07 <.050 

z 18 00 13.00 12.62 11.86 <.07 <.050 NS 

= 24.14 20.80 18.12 14.00 <01 <.001 <.025 
WV 13.57 7.80 10.12 7.78 <01 pe aR 


a For between-within analysis of variance, with 3 and 30 df. 


Since any intensive search for group dif- 
ferences is certain to disclose them, includ- 
ing spurious ones, it may be wise to under- 
interpret the individual item variations shown 
in Table 5. The burden of distilling from 
these the broader patterns of variation is 
properly borne by the factor solution. The 
choice of items for the scales derived from 
the factor solution was purely empirical, the 
intent being to use as many items as pos- 
sible without destroying the relative inde- 
pendence of the scale scores. It evolved that 
no scales share over 25% common variance, 
whereas in the original oblique solution, no 
two factors shared over 13% common vari- 
ance. While the internal consistencies of scales 
as brief as these are difficult to establish 
by traditional methods, such as the Kuder- 
Richardson formulae, their factorial origin 
offers direct evidence of their relative homo- 
geneity. 

Granting that the interpretation of meas- 
ures resting upon factored data has always 
to be provisional, the cues for the hypotheses 
which follow appear mainly in Table 6. Fac- 
tor I seems to the writer to represent a di- 
mension involving a distinct, perhaps rigid 
separation of professional and social roles in 
the therapist, most pronounced among the 
Rogerians. One pole of Factor II, with its em- 
phasis upon getting and giving information 
and help, seems associated with the tradi- 
tional, rational, flexible approach to health 
problems, and is least characteristic of the 
Rogerians. These two would seem to be the 
“principled” differences among the groups 
studied. 

Factor III is thought to reflect the broad 


spectrum, resourceful, somewhat supportive 
approach to patients, and Factor IV, with 
its focus upon the activity of the therapist, 
Stresses his artful, almost expedient virtuosity 
in dealing with his patients from moment to 
moment. Differences in these last two dimen- 
sions appear to be associated with both the 
therapist’s doctrine and his experience. 

In a series of papers, Fiedler (1, 2, 3) 
demonstrated that the dimension of communi- 
cation in psychotherapy (How well does the 
therapist understand?) is relatively independ- 
ent of the therapist’s doctrine but is sharply 
associated with his expertness, whereas the 
dimensions of status (ranging from deference 
to condescension) and, to a lesser extent, 
emotional distance (ranging from repulsed to 
seductive) reflect variations in doctrine but 
not in expertness. In attempting to relate 
Fiedler’s work to this, it is well to note that, 
although they often pass as synonymous, ex- 
perience is not expertness, and on this latter 
variable the studies may not be directly com- 
pared. The relationships among status, emo- 
tional distance, and therapeutic doctrine may, 
however, be examined, provided one is willing 
to risk some translation of the data. 

In general, Fiedler’s judges found the Ro- 
gerian therapists, irrespective of expertness, 
to be (perhaps tensely) passive and on equal 
status with their patients; Analytic therapists 
were described as aloof. The former finding 15 
perhaps mildly confirmed in the present Items 
5, 8, 10, 11, 17, 19, and 20, in all of which 
the Rogerian therapists shun the initiative. 
Evidence of analysts’ aloofness is not promi- 
nent in these data, however, probably since 
this quality relates almost exclusively to the 


| 


Doctrine and Experience of Psychotherapists 


a > which behavior is initiated. It would 
ae ei een convenient if one of Fiedler’s ma- 

r dimensions could be shown to coincide 
with certain of the factors isolated by this 
work; in the writer’s judgment, none con- 
vincingly does. 

Recent work of Strupp (6, 7, 8) offers some 
basis for comparison. Strupp presented sam- 
ple situations to therapists, recorded their re- 
sponses, and then classified these according 
to the Bales interactional system. Among his 
conclusions is that with experience comes di- 
versification in technique. The present study 
tends to confirm this, in that years of experi- 
ence correlates + .47 (P <-01) with num- 
ber of midline or “3” answers—older thera- 
pists entertain more “possible” courses of 
action. Strupp’s conclusion that experienced 
psychiatrists tend to interpret is not confirmed 
here, in that Items 20 (“Do you interpret 
.. .?”) and 33 (years doing therapy) Cor- 
relate only + .18. Strupp also found that, 
with greater experience, Rogerian psycholo- 
gists tended to be more like analytically ori- 
ented psychologists. While the present study 
lacks experienced Rogerians as 4 test of this 
finding, it is evident from the correlations in 
Table 4 that experienced eclectics are much 
less analytically oriented than their younger 


colleagues. 
Some general rese 


remain to be state 
themselves are prima 


rvations about the data 
d. The basic measures 
ry only in the sense 
that these are ways in which clinicians are 
willing to describe themselves. Next, the 
sample of respondents itself, to the degree it 
fails to represent the universe of psychothera- 
pists, introduces its own bias into the fac- 
torial solution—which solution is, in turn, a 
permissive method of ordering relationships. 
Finally, the questionnaire items represent the 
language and concerns of 4 clinician whose 
orientation is largely Rogerian. This fact 
may in some ways make it more difficult for 
individuals representing other frameworks to 
portray fairly and fully their particular man- 


ner with patients. 


Summary 


This study examines the extent to which 
differences in doctrine and in experience tend’ 
to be reflected in the behavior of psychothera- 
pists. The primary data consist of therapists’ 
reports of their handling of issues often aris- 
ing in treatment. The respondents comprise 
virtually every psychotherapist from a par- 
ticular locale, subdivided into these groups: 
Rogerians, Analysts, Young Eclectics, and 
Older Eclectics. Correlations among thera- 
pists indicate greatest homogeneity among 
the Rogerians, least among the Analysts. 
Comparisons of the responses typical for 
each group suggest that the Analysts and 
Young Eclectics resemble each other most, 
while Older Eclectics and Rogerians are least 
alike. Sharp item differences appear among 
the four groups studied, and a factor analysis 
of these items yields four clusters; brief 
scales based upon these clusters produce di- 
mensions which are differentially sensitive to 
the variables, doctrine, and experience. 
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The Problem of Early Termination: 


Is it Really the Terminee? 


Ralph H. Gundlach and Max Geller 


Postgraduate Center for Psychotherapy, New York 


A recent paper by Taulbee (5) reviewed 
the question of the early terminator in psy- 
chotherapy. The approach was to explore the 
character structure of this type of patient, as 
contrasted with that of the patient who con- 
tinues in therapy. Several studies from other 
hospitals and clinics on this topic approach 
the question in similar ways (1; 2, p, 43 i.: 
; 6). 
Terai these studies report from 30% to 
60% of their patients as terminating in 1 to 
5 sessions, the rate of termination of patients 
at the Postgraduate Center, after 1 to 5 ses- 


Of the latter, 8 had 
24 had 19 or fewer s 
had included half of 
in 1954. The lowest 


) still in treatment, while 32 had terminated. 


city, 2 had been hosp 

What can account 
ences? The Center p 
those of any other out 
education, social status, and Problems, Per- 
haps the screening of p 
different. 

It is our opinion that th 
largely due to the orientation 
of the therapists at the various institutions, 
We perhaps seek more personality reconstruc- 
tion than do the therapists at many other in- 
stitutions (4). Borderline schizophrenics and 
difficult character disorder patients can get 
involved in therapy for many months, 


e difference js 
and objectives 


Evidence that the Postgraduate Center has 
a different orientation comes also from data 
on duration of therapy. In three of the studies 
Cited, it is possible to estimate the median 
number of sessions: 8, 17, and 26. In con- 
trast, the median number of sessions for pa- 
tients at the Center terminating in 1954 was 
about 44. The survey of May 1958 showed 
129 who entered therapy during 1957, and 
262 others in treatment who had started prior 
to 1957. Thus, the patient of median duration 
was in treatment well Over one year, 

The possibility arises, then, that some of 
the studies purporting to measure differences 
in the personality of the “attriters” and “re- 
mainers” are also measuring, indirectly, the 
kind of personality problems that the staff is 
interested in, or skilled at, handling, 
Received August 1, 1958. 
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Remainer Patient Attributes and Their Relation to 
Subsequent Improvement in Psychotherapy 


Martin M. Katz, Maurice Lorr, and Eli A. Rubinstein 


Veterans Administration ? 


Reports from mental hygiene clinics indi- 
cate that of all patients accepted for psycho- 
therapy, some 30 to 65% will terminate treat- 
Ment prematurely against the advice of the 
therapist. Of those patients who remain, only 
two-thirds will be subsequently rated im- 
proved as a result of treatment (2). These 
findings have raised a number of questions 
relative to our understanding of the kind of 
patient now deriving benefit from psychother- 
apy. With respect to the problem of predict- 
ing length of stay in treatment, Frank et al. 
(3) have reviewed the significant progress 
made in this area. In more recent intensive 
investigation of the problem (5), the general 
finding that premature terminators and re- 
mainers can be distinguished with respect to 
certain patient attributes, was confirmed. The 
knowledge, however, that patients who re- 
main do not necessarily improve in treatment 
led to the question of whether the attributes 
found to discriminate between terminators 
and remainers were predictive in some degree 
of subsequent improvement also. The present 
study was intended as a preliminary investi- 
gation of this problem. In addition, certain 
therapist variables, such as years of experi- 
ence, not found to relate significantly to 
length of stay but presumed to be relevant 
to the improvement criterion, were included 


in the study. 
Method 


As part of a larger study of premature 
termination of treatment, a nationwide group 


1 Now with Psychopharmacology Service, National 


Institute of Mental Health, Silver Spring, 
2 From the Veterans Administration, Veterans Bene- 


fits Office, Washington, D. C. 


of 13 Veterans Administration Mental Hy- 
giene Clinics, using a brief self-administered 
battery of five tests, collected data on all 
cases considered for psychotherapy (4). Pa- 
tients examined for hospitalization, neurologi- 
cal disorders, or for brief (half hour or less) 
irregular treatment were excluded. The intake 
social worker completed a form at the close 
of the interview descriptive of such patient 
characteristics as occupation, annual earnings, 
highest grade completed, and presenting prob- 
lems. In addition, the worker made a predic- 
tion as to how long the patient would remain 
in treatment. At the end of the six-month pe- 
riod, if a patient still remained in treatment, 
the therapist rated the extent to which the 
patient had changed or improved as a result 
of psychotherapy. 

The 232 cases included in the study were 
randomly split into two samples of 116 cases. 
Each subsample consisted of 58 cases who 
terminated treatment with six weeks of treat- 
ment or Jess and 58 cases with 26 weeks of 
treatment or more. Analysis of data in the 
two samples by means of a double cross- 
validation procedure yielded three short tests 
which successfully differentiated patients who 
remain from those who terminate prema- 
turely. One subscale was derived from items 
included in a Behavior Disturbance Scale, 
which is designed to elicit information con- 
cerning the extent of antisocial behavior in 
the patient’s past, lack of impulse control, 
lack of personal ties, and lack of goal per- 
sistance. Another subscale was selected from 
the Taylor Manifest Anxiety Scale (6). The 
third subscale consisted of items selected from 
the Adorno, Levinson, et al. (1) F scale of 
authoritarianism. Scores on these three tests 
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and the social worker’s prediction of length 
of stay combined configurally correlated 54 
with the terminator-remainer criterion in the 
cross-validation sample. In addition, annual 
earnings and the occupational level of the pa- 
tient were found to discriminate significantly 
between the terminators and remainers. 

For the present analysis, three variables de- 
scriptive of 116 patients remaining in treat- 
ment for six months or longer were correlated 
with the therapist rating of improvement. 
‘These variables were: (a) the configural score 
based on a combination of the three sub- 
scales; (b) the occupational level of the pa- 
tient; and (c) the patient’s annual earnings 
for the preceding year. 

Three therapist variables were also corre- 
lated with the rating of improvement, al- 
though none had been found to relate signifi- 
cantly to length of stay in treatment. These 
were included in order to explore in a pre- 
liminary fashion the relation of therapists? 


characteristics to their judgment of improve- 
ment, These variables 


the therapist’s 
patient; and 
ersonal analy- 
‘apist. For the 
ssified as psy- 


) choneurotic, psychosomatic, a character dis- 


Results and Discussion 


Although all of the above described test 
and actuarial patient variables are signifi- 
cantly predictive of length of stay in treat- 
ment, not one correlates significantly with the 
measure of improvement employed in this 
study. Because these results are generally 
negative, any conclusions that can be drawn 
from the data must be highly tentative in 
nature. The findings suggest, however, that 
knowledge of those factors that determine 
whether a patient will ri 


emain in treatment 
may have little to tell us about whether he 


will subsequently improve. The failure of the 
socioeconomic variables to predict improve- 
ment confirms the finding by Frank et al, 
that patients of lower socioeconomic status, 


Martin M. Katz, Maurice Lorr, and Eli A. Rubinstein 


Table 1 


Correlations of Selected Therapist Variables with 
Therapist Improvement Rating Criterion 
in Samples A and B 


Correlation 


Sample Sample 
Variable A B 


Therapist’s years of experience 


.49* 
Patient diagnostic classification 


34* 


.39* 
BY 


* Significant at .01 level, 


although less likel 
will, if they cont 
improvement than 


y to remain in treatment, 
inue, demonstrate no less 
patients from middle eco- 
nomic groups. Consistent with this finding, 
such configural test Patterns as “low authori- 
tarian, low antisocial, high anxiety,” found to 
be highly predictive of Continuation in treat- 
ment, did not demonstrate any relation to 


An adequate 
would include 
objective test 
observers and 
it is possible 
ength of stay 
cts of what is 
rion, 

f the therapist 
- The therapist’s 
to be highly related to his 
years of experience as a psychotherapist. 
indices of improvement and 


data, jud 
follow- 


e therapists diagnostic 
the patient at the end of six 


Months as either a) ps i . 
choneurotic or psy’ 
chosomatic pl caer p 


We a (b) character disorder or psy- 
Chotic, did not Correlate with years of ex- 
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Perience, but was highly related to the im- 
Provement ratings. This finding suggests that 
patients who are diagnosed as less severely ill 
are more likely to be rated improved, regard- 
less of the therapist’s experience. Finally, the 
improvement ratings appeared to have little 
or no relation to whether the therapist had 
or had not undergone personal analysis. Ob- 
viously more has to be known about the basis 
of therapist ratings and the relation of such 
ratings to other more objective indices of im- 
provement. 


Summary 


The aim of this study was to investigate 
the relation between patient attributes found 
to be significantly predictive of length of 
stay in psychotherapy and subsequent im- 
Provement in treatment. A test variable, the 
configural score, and two actuarial variables 
(occupational level and annual earnings) 
were correlated with therapists’ ratings of im- 
Provement following a six-month period of 
treatment. No one of the above variables was 
found to correlate significantly with the cri- 
terion. The results suggest that patient at- 
tributes associated with subsequent improve- 
ment may be very different from those that 
determine whether a patient will continue 1m 
treatment. The nature of the criterion, how- 
€ver, imposes certain limitations on conclu- 


sions that can be drawn from the data. It was 
found, for example, that therapist improve- 
ment ratings were significantly related to his 
years of experience as therapist and to his 
diagnostic classification of the patient fol- 
lowing six months of treatment. The need for 
investigating additional hypotheses concern- 
ing characteristics of potential stayers in psy- 
chotherapy in relation to other independent 
criteria is emphasized. 
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A Note on McNemat’s “On Abbreviated 
Wechsler-Bellevue Scales” 


William Howard 


Central Louisiana State Hospital, Pineville, Louisiana 


McNemar’s article (2), in which he com- 
puted the correlations between short forms 
and the full scale Wechsler-Bellevue for 
Wechsler’s standardization group, contains an 
error. The culprit is hiding in the first radical 
in the denominator of the special formula, and 
reduces all of the reported correlations slightly 
below their true values. 

Although studies have appeared on short- 
form—full-scale correlations for the WAIS (1, 
3, 4), the test which has officially replaced 
the WB, McNemar’s study on the WB re- 
mains important since the WB is still being 
used in some clinical settings. Furthermore, 
investigators compare their WAIS results with 
his WB findings. 

Maxwell (3) repeated McNemar’s pro- 
cedure on the WAIS standardization group. 
In general, she found WAIS short forms pro- 
duce higher correlations than do the WB 
short forms. Although the best WAIS com- 
binations do not contain the same subtests as 
the best WB forms, even McNemar’s reported 
WB correlations are lower than the correla- 
tions for the same WAIS combinations. Max- 
well refers to this in her statement: “With 
the exception of one duad, all WAIS com- 
binations yield larger correlations than cor- 
responding WB scales.” When the WB corre- 
lations are corrected however, this last 
observation is not valid. 

The first radical in the denominator for Mc- 
Nemar’s general formula is V30; + 23 ryouo;. 
In arriving at his special formula he assumes 
that all o’s are equal to 3. This allows factor- 
ing out the o*’s so that the radical becomes 
oV/n + 237. The term S74, the sum of sub- 
test intercorrelations given by Wechsler in 


Table 41 (5) is equal to 20.01, and x is the 
number of subtests. In the special formula for 
WB, the value of the radical is \/50.02, or 
7.0725, rather than 7.26 as reported. (The o 
cancels out with the same factor in the nu- 
merator.) Therefore, all of McNemar’s cor- 
relations must be increased by a factor of 
7.26/7.0725, or 1.0265. 

This correction so increases the WB cor- 
relations that they exceed the corresponding 
WAIS correlations for 24 of the 40 short 
forms reported by McNemar. The WB cor- 
relations are equal to the WAIS results in 
three of the remaining instances. 

The correction does not alter the basic re- 
sult of Maxwell's study. In spite of the in- 
creases, the best WB short forms are slightly 
inferior to the best WAIS combinations, In 
all cases, but especially for the tetrads and 
pentads, the differences are very small after 
the WB correlations are corrected. 


Received June 18, 1958. 
Early Publication, 


References 


1. Doppelt, J. Estimating the full scale score on the 
Wechsler Adult Intelligence Scale from scores 
on four subtests. J. consult, Psychol., 1956, 
20, 63-66. 

2. McNemar, Q. On abbreviated Wechsler-Bellevue 
scales. J. consult, Psychol, 1950, 14, 79-81. 

3. Maxwell, Eileen. Validities of abbreviated WAIS 
scales. J. consult, Psychol., 1957, 21, 121-126. 

4. Olin, T. D., & Reznikoff, M. The use of Doppelt’s 
short form of the Wechsler Adult Intelligence 
Scale with Psychiatric Patients. J. consult. Psy- 
chol., 1957, 21, 27-28. 

5. Wechsler, D. The measurement of adult intelli- 
gence. (3rd ed.) Baltimore: Williams & Wil- 
kins, 1944. 


i 414 


Journal i 
Val 22, Kie egsulting Psychology 


Conditioning of Hostile Verbalizations in a Situation 


Resembling a Clinical Interview 


1 


Arnold H. Buss 


University of Pittsburgh 


and Ann Durkee 


Purdue University 


e recurrent obstacle in interviewing and 
Psychotherapy is the verbal inhibition of cli- 
ats Topics that are associated with anxiety 
oa avoided or discussed only with the great- 
St reluctance, Since little progress can be ex- 
hia unless problems are brought up and 
iscussed, verbal inhibition is clearly an im- 
Portant area for clinical research. 
eae research may take two forms. First, 
i atim interviews could be examined to de- 
t mine the psychologist’s techniques of facili- 
ating verbalization, and then the success of 
we techniques might be measured. The second 
orm involves setting up a laboratory analogue 
Of the interview situation and investigating 
the effect of the experimenter’s (E’s) verbal 
ehavior on the subject’s (S’s) verbalizations. 
he present study is of the second kind. 

It was felt that while the situation should 
resemble a clinical interview as closely as pos- 
Sible, discrete trials should be employed for 
better control of reinforcement by the 

herefore the task of making up sentences 
Was used. This task was first used by Taffel 
(2), who had a series of 3 x 5 cards, each 
Containing a verb and six pronouns. The S 
Was instructed to make up a sentence using 
the verb and one of the six pronouns. After 
an initial period of free responding, the S was 
reinforced for every sentence containing the 
Pronoun “I” or “We.” Taffel compared this 
Procedure to a therapist’s reinforcing 4 cli- 
ent’s talking about himself. 


d to Herbert Gerjuoy, 


`The writ indebt 
iters are indeb Fi Ais i their help- 


George Wischner, and Melvi 
ul suggestions. 


Self-reference content is not usually asso- 

ciated with anxiety, whereas anxiety often 
accompanies verbalization of hostile content. 
Often clients are able to talk about their hos- 
tile impulses only after their strong inhibi- 
tions are removed or weakened. Such inhibi- 
tion may also be expected in a nonclinical 
population because it is part of general cul- 
tural training to suppress and punish hos- 
tility. 
The present study seeks to investigate the 
verbal conditioning of hostile and neutral ma- 
terial. Since inhibition is expected to retard 
verbalization of hostile content, the learning 
of hostile material should be slower than the 
learning of neutral material. Also, since men 
are allowed a greater variety and intensity of 
hostile response in our culture, men should 
learn hostile material faster than women. 


Method 


Stimuli 

Two considerations dictated the initial 
choice of words. First, the grammatical form 
should be constant, and therefore only verbs 
in the past tense were used. Second, slang and 
pedantry should be avoided, and only rela- 
tively familiar verbs were selected. 

In compiling a list of hostile words a wide range 
of intensity was noted, eg. stabbed, tortured vs. 
criticised, resented. It was decided to have two de- 
grees of hostility, mild and intense. A compilation 
of hostile and neutral words was submitted to six 
judges, who sorted them into neutral, mildly hos- 


2 The writers wish to thank Idel Bruckman, Mary 
Oltean, Jerry Wiggins, and Marvin Zuckerman for 
serving as judges. The writers served as the fifth and 


sixth judges. 
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tile, and intensely hostile groups. The criterion of 
acceptance of a word was agreement by five of the 
six judges. 

Next, the Thorndike-Lorge word count (3) was 
used to match the frequencies of the three types of 
verbs. Finally, the matched words were placed on 
3 x 5 white index cards. There were 30 such cards, 
each with a neutral, a mildly hostile, and an in- 
tensely hostile verb. Since a pilot study revealed that 
50 or 60 trials would be required for learning to 
occur, the number of cards had to be doubled. This 
was accomplished by using each of the words twice. 
The second time a word was used, it was accom- 
panied on the card by different words than had ac- 
companied it the first time. For example, tortured 
appeared on a card with argued and invented the 
first time and with flattered and rebelled the second 
time. The order of placement of the verbs on the 
cards and the order of presentation of cards were 
randomized for the series of 60 trials. 


Experimental Design 


There were two groups of Ss and 60 trials. 
During Trials 1-10, the Ss made up sentences 
but received no reinforcement. This free re- 
sponding period established the frequency of 
response for each type of word prior to con- 
ditioning. During Trials 11-60, one group of 
Ss was reinforced for using neutral verbs, and 
the other group was reinforced for using in- 
tensely hostile words. There was no group 
that was reinforced for using mildly hostile 
words; in this exploratory research the writers 
felt that any differences in learning should be 
maximized by using the extreme of hostility. 
Therefore, of the hostile verbs, only the in- 
tensely hostile ones were reinforced, and here- 
after the term hostile verbs will refer only to 
intensely hostile verbs. 


Procedure 


Each S was instructed to make up a sen- 
tence using one of the three verbs on each 
card. During Trials 1-10 the E said nothing, 
During Trials 11-60 the Z said Right after 
the correct verb was used and Wrong after an 
incorrect verb was used. 


Subjects 


The Ss were 80 college students, 40 men 
and 40 women. Within each sex, Ss were as- 


8 Words were grouped into three categories: 0-24, 
25-50, and above 50 times per million according to 
the Thorndike-Lorge count. Thus the three kinds of 
verbs were matched on the basis of the frequency 
range in which they fell. 
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Fig. 1. Acquisition curves of men and women rein- 


forced for hostile and neutral words. 


signed randomly to either the neutral rein- 
forced group or the hostile reinforced group, 
and each group had 20 men and 20 women. 


Results 


The 60-trial series was divided into six 
blocks of ten trials each. The measure of 
learning is the frequency of occurrence of the 
response Class that was reinforced. For the 
Neutral group the frequency of neutral words 
per block of ten trials is the measure, and for 
the Hostile group the frequency of hostile 
words per block of ten trials is the measure. 
The learning curves for the two groups and 
for both sexes are plotted in Fig. 1. Inspec- 
tion of these curves reveals clear-cut differ- 
ences in the height of the curves. Also the 
rate of learning hostile words (the shape of 
the curves) appears to be slightly faster than 
the rate of learning neutral words. 

The significance these trends was tested 
by a Lindquist Type IIT analysis of variance 
( 1). This analysis of variance is summarized 
in Table 1. In this table the main effects for 
Words, the main effects for Sex, and the 
Words X Sex interaction reflect differences in 
the height of the curves, Differences in the 
shape of the Curves (rate of learning) are re- 
flected in the Words x Trials and Sex * 
Trials interactions, 

The significant F ratios for Words and for 
Words Xx Sex indicate that there are signifi- 
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Conditioning of Hostile Verbalizations 


Table 1 


Analysis of Variance of Hostile and Neutral Responses 
of Men and Women for Blocks of 10 Trials 


Mean 
Source df square F 

eatin 1 9364  505* 
ex 1 30.00 1.62 
Words X Sex 1 200.21 10.79* 
Error (between) 76 18.55 
Trials 5 4945 15.46** 
Trials X Words $s ya 353" 
Trials X Sex 5 66 21 
eels X Sex X Words 5 470 147 
error (within) 380 3.20 
Total 479 
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cant differences in the height of the four 
Curves, Since there was a significant Words X 
Sex interaction, four comparisons were made: 
men’s neutral vs. men’s hostile; women’s neu- 
tral vs. women’s hostile; men’s neutral vs. 
Women’s neutral; and men’s hostile vs. wom- 
en’s hostile. Two of the four comparisons 
Yielded significant differences. The women’s 
hostile curve was (a) significantly lower than 
the women’s neutral curve (¢+3.19, P< 
001 for 76 df) and (b) significantly lower 
than the men’s hostile curve (t = 2-63, Ż < 
-02 for 380 df). r 

The significant F ratio for trials indicates 
that conditioning did occur (significant in- 
Creases in frequency of response on succes- 
sive blocks of trials). The significant Words 
X Trials interaction suggests that the shape 
of the neutral curves was significantly differ- 
ent from the shape of the hostile curves. Evi- 
dently the rate of learning hostile words is 
significantly faster than the rate of learning 
neutral words. 

The first 10 trials constituted the free re- 
sponding period, during which the Z said 
nothing after all of the Ss’ responses: Since 
all Ss were treated alike during this period, 
the data from each group may be pooled. 

On each trial the S could respond with a 
neutral, a mildly hostile, or an intensely hos- 
tile word. In order to simplify the chi square 
test of difference in frequency of response, the 
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neutral and mildly hostile words were pooled. 
It was now possible to test the significance of 
sex differences in frequency of response of in- 
tensely hostile vs. neutral and mildly hostile- 
words during the first ten trials. 

For the 10-trial period there were 11 pos- 
sible combinations of frequencies: 10 neutral-. 
mildly hostile, 0 intensely hostile; 9 neutral- 
mildly hostile, 1 intensely hostile; ...0 neu- 
tral-mildly hostile, 10 intensely hostile. These- 
combinations for men and women constituted 
a contingency table which yielded a chi square- 
of 21.2, which is significant at the .01 level 
of confidence. Thus the women gave signifi- 
cantly fewer intensely hostile and significantly 
more neutral-mildly hostile responses than the- 
men during the free responding period. 


Discussion 


It was predicted that neutral material would’ 
be learned at a faster rate than hostile ma- 
terial. The results proved otherwise, with hos-. 
tile words being conditioned faster than neu- 
tral words. A variable that was not discussed’ 
previously may have contributed to these find- 
ings: size of response class. The hostile verbs. 
were sampled from a population of a few hun- 
dred hostile verbs, but the population of neu- 
tral verbs is many thousands. Learning of a 
large class of responses is expected to be 
slower than learning of a small class. Hence 
neutral verbs were conditioned at a slower 
rate than hostile verbs, despite the inhibition 
associated with the latter. 

Tt was also predicted that women would 
manifest slower learning of hostile verbaliza- 
tions than men. This prediction was not borne 
out. Rather, the greater inhibition present in 
women was revealed in the absolute number 
of hostile verbs used. Both in free responding 
and acquisition, women produced significantly 
fewer intensely hostile verbs than men. The 
intensely hostile verbs referred mainly to 
physical violence, €.8., lynched, mauled, 
smashed, stabbed, strangled, and tortured. 
The actions represented by these words are 
severely punished in our culture; they are 
occasionally allowed by men but never by 
women. This difference in cultural training 
would seem to account for the sex difference 
in frequency of hostile response. 
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However, the inhibition that depressed fre- 
quency of response did not prevent the 
women from conditioning. While their fre- 
quency of hostile response was initially low, 
it increased with successive acquisition trials. 
If this finding is confirmed with clinical popu- 
lations, it would prove encouraging, for it 
suggests that initial inhibition of response can 
be overcome by reinforcement. In the investi- 
gation of this and other clinical issues the 
present analogue to a clinical interview would 
seem to be promising. 


Summary 


The task of making up sentences was con- 
ceptualized as a laboratory analogue of a 
clinical interview. There were two groups of 
college students, each group consisting of 20 
men and 20 women. One group was reinforced 
for intensely hostile verbalizations and the 
other group for neutral verbalizations. 

It was found that intensely hostile verbali- 
zations were conditioned faster than neutral 
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verbalizations. This was attributed to the 
larger size and the diffuseness of the neutral 
class in comparison to the intensely hostile 
response class. Women produced significantly 
fewer intensely hostile responses than men, 
which was held to be consistent with sex dif- 
ferences in cultural training. Initial inhibition 
of response did not prevent conditioning from 
occurring in women. It was suggested that 
both the findings and the technique have 
clinical implications. 
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By utilizing an interview standardized along 
certain minimal dimensions, it has been pos- 
sible to investigate certain characteristics of 
the overt interaction patterns of different 
groups of subjects (8, 9, 10, 11, 12, 13, 14, 
15, 16, 17). Results to date suggest that in- 
terviewee interaction patterns have the fol- 
lowing characteristics. First, there are wide 
individual differences in interaction patterns 
among subjects. Second, the interviewee in- 
teraction characteristics for any given subject 
are highly stable across two different inter- 
viewers when the latter standardize their in- 
terviewing behavior along the minimal prede- 
fined dimensions of our standardized method, 
and, at the same time, these interviewee char- 
acteristics are modifiable by planned changes 
ue the intra-interview behavior of either inter- 
viewer (10, 15, 17). Third, the marked sta- 
bility and modifiability of an individual's in- 
teraction patterns, found for our first sample 
of subjects (15), were cross-validated in a 
second sample (9). And fourth, the stability 
and modifiability were equally striking when 
only a single interviewer was used and the 
test-retest interval was extended to seven 
days (16), five weeks (17), and eight months 
(17), in contrast to the first two studies 
which employed a test-retest interval of a 
few minutes. . 

The finding that interviewee interaction 
Patterns are stable under identical (along 
Certain dimensions) interpersonal environmen- 
tal stimulus conditions and modifiable when 
ed by a research 
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these environmental conditions change can be 
thought of as constituting one type of evi- 
dence of the construct validity of the inter- 
action patterns (1, pp. 13-28; 5, p. 288). 
However, most of our research to date has 
concerned itself with establishing the reliabil- 
ity of these interview interaction variables. 
Thus we have studied and established as hav- 
ing extremely high reliability the following 
aspects of interview interaction behavior: the 
reliability of the interviewer who serves as 
the independent variable by conducting the 
standardized interview (9, 15, 17); the reli- 
ability of the interviewee interaction patterns, 
the dependent variables (9, 15, 16, 17); the 
reliability of the observer who observes the 
interviewer-interviewee interaction and rec- 
ords his observations by pressing separate 
keys for each participant (14); and, finally, 
the reliability of the scorer who scores the 
final Interaction Chronograph record (15, P: 
429). 

Having thus established unusually high re- 
liabilities for these interview interaction vari- 
ables, it was appropriate to turn to the ques- 
tion of their validity, or “meaning.” It was 
apparent to us that the question of the va- 
lidity of our measures, as of most personality 
measures derived from other frameworks, was 
made all the more difficult to investigate by 
the fact that there exists no well-defined or 
highly integrated interaction theory of per- 
sonality from which hypotheses relevant to 
validity could be generated. For this reason 
we have approached the validity problem 
from a number of points of view; amounting 
largely to what Cronbach and Meehl call the 
“bootstraps” method (5, pp. 286-287). When 
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sufficient studies bearing on validity have been 
conducted and reported, it is hoped that a 
preliminary theory of interaction can be for- 
mulated and new, specific hypotheses gener- 
ated and tested. To date we have reported 
one validity study (12) and soon will be re- 
porting two additional ones (11, 13). 

The work here being reported, a factor- 
analysis of the 12 interview interaction vari- 
ables used by us before the recent addition 
of two additional variables, is an example of 
what Cronbach and Meehl call construct va- 
lidity (5, p. 287). The three other validity 
Studies are more properly 
current validity (1). The 
ported, deals with Psychological test corre- 
lates of these interview interaction behaviors 
(12). The second, on the relationship be- 


Joseph D. Matarazzo, George Saslow, and A. Paul Hare 


of measurement used during the 60 interviews. The 
rules of the standardized interview (8) require the 
interviewer to follow certain simple predefined be- 
havioral patterns (for example, that each of the in- 
terviewer’s comments should be 5 seconds in dura- 
tion). In addition, the rules require the interviewer 
to vary his behavior somewhat during each of five 


constitutes a sequence of different behavioral situa- 
tions, or what can be thought of as varying minia- 


overt behavior (“not responding” and “interrupting,” 1 


» and not by the 
interviewee. The 


be the interviewer or 1 
cate length of the Standardized interview 
ged for these 60 Sg Tom 24.5 minutes with one 
The mean length oe, (50.3) minutes for another. 
. T 5 i i 
with this outpatient fino, Y mie 
ore complete definitio 


ables here factor anal; 
s yzed can b i 
earlier reports (8, 15), Briefly, eae 
Units, the number of tj 
Pt2s Action, th 
actions; 
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; avera; 
n Plus its following inaction, 
ctivity, the average 
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Table 1 


Interco i ' i 
rrelations (Pearson r’s) Among Interaction Variables Based on Interviews in a Sample of 60 Subj 
First Interviews Above the Diagonal, Second Interviews Below the Diagonal aa? 


Variables 1 2 3 4 5 6 7 8 9 10 H i 

1. Pt.’s Units _73 17 —82 —83 —20 —05 
te ; n wee —20 —05 ól 7 =2 

3 Pts Action ~73 30 92 88 22 20 —54 th. & ae 
z Dee D engs 19 —27 —22 —41 —76 —73 55 23 —68 —52 —84 
are rempo -83 95 —19 9 #19 22 —52 -79 17 05 35 
P A Activity —81 95 —36 98 34 33 —63 —S82 30 13 51 
7 iat niment —08 19 —78 il 26 48 —45 —25 50 4 61 
is . rs Adjustment 03. 32 -76 22 35 5 ih =O ST | a se 
9, i A eee 64 —36 47 —42 —47 —26 —08 70 —74 —21 —64 
hy eee 95 —62 25 —71 —70 —13 06 74 —28 06 —34 
i. mee Initiative (Per. 2) —33 36 —62 33 42 32 59 —58 —39 33 76 
iz t?s Dominance (Per. 4) —03 17 —32 17 22 37 33 —01 12 05 43 
. Pts Quickness (Per. 2) o a-s 5 o o -a EON 


Note.—For r = .25, p < .05. 
For r = .32, p < 01. 


Results 


The retest standardized inte 
of the 60 Ss made it possible to replicate and 
thus check the reproducibility (through an 
attempt at cross-validation) of the results of 
the factor analysis of the 60 first interviews. 


In Table 1 is shown the matrix of intercor- 
relations (Pearson r’s)* of the 12 interview 
d from the 60 in- 


interaction variables derive 
tetviews, The intercorrelations for both the 
first and second (replication) interviews are 
included in the one table in order to facili- 
tate comparison. Intercorrelations for the 
data of the first interview are given above 
the diagonal in Table 1, while the intercor- 
relations for the second interview are shown 
below the diagonal. As can be seen, the in- 
tercorrelation values for the replication inter- 
view are strikingly similar to those shown for 
the original interview and constitute a clear 
cross-validation of the findings with the 60 
first interviews. 

Before going on to th 
these data, several poin 
worth noting. The first of t 


rview on each 


e factor analysis of 
ts in Table 1 are 
hese is the high 


tistical assumption of a norma 
Initiative deviated somewhat, with S 
at the low end (0.00) and piling-uP 9! 


(1.00). 


negative correlation (—.73) between how 
often a patient speaks (Pt.’s Units) in the 
standardized interview and the average dura- 
tion of each of these units of utterance (Pt.’s 
Action). It would appear that people who 
speak often in the standardized interview do 
so in relatively brief utterances, whereas peo- 
ple who speak infrequently tend to do so 
in correspondingly longer utterances. On the 
other hand, since a correlation between two 
events merely indicates an existing relation- 
ship but tells us nothing about which event 
influences the other, one can also interpret 
this — .73 relationship to mean that people 
who habitually speak in brief utterances do 
so relatively frequently; whereas individuals 
whose utterances tend on the average to be 
quite lengthy, seem to speak much less often. 
This finding would indeed be an interesting 
addition to our knowledge of human behavior 
were it not for the possibility that it may 
represent an artifact of the standardized in- 
terview. It will be remembered that three pe- 
riods [1, 3, and 5], constituting 20 minutes 
of the standardized interview, are of fixed 
duration, whereas, on the average, only 12 
minutes (but potentially 30 minutes for all 
Ss) are of variable length. Thus, in a par- 


3 For the 60 Ss of this study, the range for the 
combined length of the two variable periods (Pe- 
riods 2 and 4) was from 4 minutes to 30 minutes 

: 


with a mean of 12 minutes. 
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tially “closed system,” whose limits on dura- 
tions (and thus indirectly on units) are pre- 
scribed in advance, it is not surprising that 
a negative correlation should exist between 
number of units and average duration of ac- 
tion. It is clear that an S who acts 112 times 
during a 32-minute interview must do so in 
briefer durations than a second § who inter- 
acts only 25 times during the same period. 
The high negative correlation is probably not 
all artifact, however, since up to 30 minutes 
of the interview are variable and unfixed in 
regard to duration, with the interviewer ter- 
minating each of Periods 2 and 4 after any- 
where between 1 and 15 minutes, depending 
on the patient’s “unrestricted,” in this sense, 
behavior in these periods. However, it is pos- 
sible better to test the degree of correlation 
between number of units and average duration 
of action by observing a series of pairs of two 
individuals in a free conversation, or a single 
pair of individuals in a series of free conversa- 
tions (free of predetermined time limits). We 
plan to carry out such studies as a more ade- 
quate test of this initial finding. 
A second finding of interest in Table 1 is 
the relative independence of Pts Units and 
the following variables: Pt.’s Silence; Pt.’s 
Adjustment; Dr.’s Adjustment; Pt.’s Initia- 
tive; Pt.’s Dominance; and Pt.’s Quickness. 
In part, this is in accordance with Chapple’s 
original plan since, as with a technique like 
the Rorschach, in order to make comparable 
the results from Ss with different numbers of 
interaction units, all Interaction Chronograph 
variables are divided by the number of units 
for that individual (8, p, 354). It is clear, 
however, that even though the influence upon 
all variables of different numbers of units 
among different Ss has been thus partly con- 
trolled, there is still a highly significant nega- 
tive correlation between number of units and 
one of these variables, average duration of 
action (described above). That is, after re- 
lating all variables to the same scale, Pt.’s 
Units still correlate with Pt,’s Action, whereas 
Pt.’s Units does not correlate materially with 
Pt.’s Silence, Pt.’s Adjustment, Pt.’s Initia- 
tive, Pt.’s Dominance, and Pt,’s Quickness, 
Thus, in descriptive language it would ap- 
pear that how long a person is silent (in sur- 
prising contrast to how long he acts); how 
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he maladjusts, when he does so in two-person 
interactions; how often he takes the initia- 
tive; and how quick he is to do so; and how 
often he dominates or is dominated are all 
behavioral characteristics which are independ- 
ent of his total number of units (i.e., his fre- 
quency of interaction). 

Other findings of interest seen in the first 
interview data in Table 1 are: the moderate 
negative correlation between action and si- 
lence (—.30); the moderate positive correla- 
tion between duration of action and frequency 
of initiative-taking (.25); the independence 
of duration of action and frequency of domi- 
nance (.12); the high negative correlation 
between silence and initiative (—.68), i.e 
the person with the longest silences shows 
the fewest initiatives and vice versa; the posi- 
and ini- 
tiative (.50), and between adjustment and 
and 
the moderate positive 
correlation between Pt,’s Initiative and Pt.’s 
Dominance (.33), which, however, was not 
cross-validated (.05); and, finally, the high 


do it (.76). 


Both sets of intercorrelations shown in 
Table 1 were factor analyzed, the factors 
being extracted by using Thurstone’s centroid 
method * (18, pp. 161-170). In Table 2 are 
shown the original centroid factor loadings 
and the rotated factor loadings for the 60 
first interviews, while in Table 3 are show? 
similar values for the sample of 60 second 
(replication) interviews, 

From an inspection of Tables 2 and 3 it is 
clear that the results of the factor analysis of 
the 60 first interviews were highly reliably 
Cross-validated on the sample of 60 second 
interviews. Thus, it is necessary only to de- 
Scribe the results shown in Table 2. From 
the column of rotated factor loadings under 
Factor I in this table it would appear that 
this first factor is in Part a latency, or spee 


£ In extracting the factors, using Thurstone’s Cen- 
troid method as a base, computations were mac? 
on IBM machines, using procedures developed bY 
Arthur Couch with assistance from Eugene Kast 
baum, both of the Department of Social Relations 
at Harvard University, 
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Table 2 


Factors for Interaction Variables Bas 


ed on First Interview of 60 Patients 


Centroid Loadings 


Rotated Loadings 


Variables I nh m N Vv I m aw Iy h? 
1. Pt’s Units W -6 7 Ww % 05 —9 20 —04 93 
2. Pts Action -74 49 25 O4 16 -18 87 20 —15 85 
3. Pts Silence 75 56 08 13 —07 93 -13 15 ©% 90 
4. Pt.’s Tempo —7 57 30 —02 04 =—12 93 20 -23 96 
aga ee Reng 
. Pt.’s Adjustn —62 —41 —18 —3 -7 5 -36 — 
7. Dr.’s p 8 eA Zez -55 30 12 —16 -83 05 30 —13 79 
8. Pts Sy ‘pati 79 —07 38 —26 —10 $1 —61 08 —45 84 
s Synchronization 79 2 
iz Dr.’s Units 72 —60 29 05 14 n E a H g 
| Pt.’s Initiati = —3g8 —30 41 09 -7 2 
fhe ee Ot SIR AO 257 -05 —02 —18 36 
i2, Bem ominance: (er 4) =i 06 19 =14 —91 25 18 09 93 
i Berne) m62 =M Sil. Act. Adj. Init. 
Table 3 
k ‘ siew of 60 Patient: 
RRENA Factors for Interaction Variables Based on Second Interview 0 atients 
Centroid Loadings Rotated Loadings 
Variables I nm W v a ee 
1, , A ee es 14 12 07 06 —95 18 —01 95 
2; Ps Tiis e e 37 17 —07 -27 838 38 -14 93 
3, Bits hae 3 a B D gB 93 —10. 23 0 93 
L Pes Tease -n 532 3 B —04 —18 91 32 —15 99 
aoe Tempo oc 2s i 03 —34 89 28 —18 102 
6. Pts Adjust Dg = oF We OH ow op ee 
2. Drs liren = -0 a z Zi "35 = 45 —27 A 
Den, — 
9. Pts Synchronization so = 38 83 19 os —90 36 -18 97 
1 t.’s Units 34 34 16 -66 32 00 48 76 
1 Rts Initiative (Per. 2) —— 2 ps 2 =38 00 09 —42 33 
17. BUS Dominance (Per. 4) -27 ~4 -22 30 =05 -90 23 06 37 100 
» Pt’s Quickness (Per. 2) —80 Sil. Act. Adj. Init. 
H i i ilence: the former variable 
o Bg ts how tion of interview SI f 
yi Tesponse measure. That Ei pe ge, be- measures this for all five periods, the latter 
"an z patient is silent, i basen Jast ut- variable only during Period 2 The minus 
fee e responds to the inte Tabel this a sign of the factor loading for Pt. s Quickness 
ance, For simplicity one can (—.91) should be disregarded in the inter- 


“silence” factor. Patient interview interaction 
Variables having the highest rotated loadings 
on this first factor are Pt.’s Silence (2) 
t?s Adjustment (—.73), PYS Synchro 
tion (.51), Pts Initiative (—-74), ý sh 

ominance’ (—.87), and Pt's Quem 
—.91). By Interaction Chronograph. D 3 
urement, Pt.’s Silence and Pt.’s Quicknes 
are both measures of a patient’s average dura- 


pretation of this first factor as the negative 
direction is an artifact of measurement due 
solely to the inverse manner in which this 
variable is recorded in the present model of 
the Interaction Chronograph. (One or two 
other variables pose similar but unimportant 
“sign” artifacts.) Pt.’s Adjustment, which has 
the next highest loading on Factor I, is also 
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a silence measure, i.e., the average of the 
durations of a patient’s interruptions minus 
the durations of his failures to respond (si- 
E last two variables with loadings on 
this factor, Pt.’s Initiative and Pt.’s Domi- 
nance, are both frequency measures and thus 
differ from the former, all of which are dura- 
tion measures. Pt.’s Initiative represents the 
percentage of times the patient took the ini- 
tiative (i.e., spoke again following his own 
last utterance) during the interviewer's 12 
prescribed failures to respond in Period 2. 
Thus, in a sense, it might be speculated that 
the Pt.’s Initiative variable could reflect a 
“drive” ° aspect of human interaction (i.e., 
an additional parameter of an individual's 
frequency of interaction) or, at the least, 
more than what is measured by the duration 
measure, Pt.’s Silence, alone. That is, how 
long one waits before he acts (Pt.’s Silence) 
as an Interaction Chronograph measure, 
would seem not to reflect all that is involved 
in the Pt.’s Initiative variable and vice versa. 
For there are some patients who will act, i.e., 
will take the initiative, and there are others 
who will not under conditions of interviewer 
silence. Both types of patients receive dura- 
tions of silence scores, while only the for- 
mer group receives an initiative score for this 
unit of interaction. (The tenability of this 
dual-nature hypothesis of Pt.’s Initiative is 
strengthened by the fact that Pt.’s Initiative 
is the best measure of the Fourth Factor, 
with a factor loading of .50 on it. This will 
be described below.) 

The factor loading of —.57 for Pt.’s Domi- 
nance on Factor I indicates that there may be 
still a third parameter present in this “dura- 
tion of silence” first factor. That is, this fac- 
tor loading of —.57 for Pt.’s Dominance on 
Factor I (“silence”) shown in Table 2, and 
the r of —.52 between Pt.’s Dominance and 
Pt.’s Silence shown in Table 1, indicate that 
people who tend to have long durations of si- 
lence during their interview tend also signifi- 
cantly not to dominate or out-talk the inter- 


5 Some evidence for this hypothesis (12, p. 332) 
comes from a cross-validated statistically significant 
r of .44 between our Pt.’s Initiative variable and a 
patient’s score on the Taylor Anxiety Scale (pur- 
ported to be a measure of Hullian drive level). 
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viewer when he interrupts them 12 times in 
Period 4. This finding that patients with 
longer average interview silences exhibit a 
greater frequency of terminations of speech 
(submissions) when interrupted, would seem 
to open up a new area for future research to 
further our understanding of still other as- 
pects of two-person interactions. 

The second rotated factor shown in Table 2 
(and cross-validated in Table 3) appears to 
reflect “duration of patient action per unit, 
i.e., how long on the average the patient spoke 
or otherwise communicated during each of his 
interaction units. This “action” factor reflects 
the earlier discussed high negative correlation 
between Pt.’s Units and Pt.’s Action, as can 
be seen by the factor loading of —.94 for 
Pt.’s Units and of .87 for Pt.’s Action on 
Factor II. Other patient variables with high 
loadings on the second factor are: Tempo 
and Activity (both 93), and Synchronization 
(—.61). The loading of —.93 for Dr.’s 
Units on this factor reflects the 7’s of .97 and 
-95 (shown in Table 1, above and below the 
diagonal, respectively) between Pt.’s Units 
and Dr.’s Units. The latter near unity corre- 
lations are not surprising since the tules of 
the partially standardized interview require 
the interviewer (in all periods but the second) 
to take his lead from the interviewee and to 
respond with a five-second utterance to each 
of the patient’s communication units, thus 
earning the interviewer one Dr.’s Unit for 
each Pt.’s Unit. 

The loadings on Factor II of 93 for Pt.’s 
Tempo and .93 for Pt.’s Activity are interest- 
ing since they indicate that the “action” fac- 
tor is highly saturated with these two derived 
interview interaction variables. Since these 
same variables do not appear in the “silence,” 
or first factor (loadings of —.12 and —.28, 
respectively), it would appear that, as inter- 
view variables, Pt.’s Tempo and Pt.’s Activity 
are made up primarily of Pt.’s Action rather 
than Pt.’s Silence; despite the fact that Pt.’s 
Tempo is scored as the average sum of Pt.’s 
Action plus Pt.’s Silence while Pts Activity 
is scored as the average Pt.’s Action minus 
Pt.’s Silence. This fact is shown even more 
clearly in Table 1, where it is seen that Pt.’s 
Action has very high correlations with Pt.’s 
Tempo and Pts Activity (.92 and .88, re- 
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spectively, in the first interview; and .95 and 
95 in the replication interview) whereas Pt.’s 
Silence has only minimal correlation with 
these same variables (—.22 and —.41, re- 
spectively; and —.19 and —.36). In part 
this Is due to the restricted range of durations 
of silence (from 5 to 19 hundredths of a 
Minute for this sample) relative to the greater 
range of durations of action (from 11 to 257 
hundredths of a minute) (10). 
P Thus the high loadings of Pt.’s Tempo and 

t?s Activity, as well as that of Dr.’s Units 
on Factor II, would appear to be reflections 
of the derived nature of these two former 
variables, including the differences in range 
for silence and action, and the standardized 
rules governing the interviewer's behavior in 
regard to the Drs Units variable. With the 
Exception of Pt.’s Synchronization, which is 
highly correlated with Pt.’s Units (see Table 
1), the absence of significant loadings of any 
Of the other interview variables on F. actor II 
Would indicate that it is purely a reflection 
of how often a patient communicates (Pt.’s 
Units) and how long on the average he talks 
once he has begun (Pts Action). Although 
Factor II justifiably could thus equally be 
thought of as reflecting units, or one’s num- 

er of interactions (a frequency measure), we 
Prefer for the time being to call it “action 
and thus think of it as a duration measure. 
Only further research will permit us to begin 
to unravel the interesting question of whether 
one’s frequency of (inter) action determines 
his duration of action, or vice versa, or neither 
(as, for example, in free in contrast to stand- 
ardized interviewing). 

Rotated Factor III in Table 2 appears to 

be a much weaker factor than either Factors 

or II; with no factor loading reaching a 
level above (minus) .36. This weak factor 1s 
saturated most heavily with Pt.’s Adjustment 


(factor loading of —.36), and less so by Pt.’s 
), Pts Tempo 


Dr.’s Units 


Table 3, although, in this table, Pt.. 

chronization (the ‘frequency wit ch the 
Patient maladjusts, which with vt 
Subject involves a frequency count of ow 
often he fails to respond quickly to the inter- 
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viewer rather than how often he interrupts 
the interviewer) has the highest factor load- 
ing (.45). Since all the other interview vari- 
ables with loadings on Factor III in Tables 2 
and 3 reflect a duration measure in one way 
or another—either of actions or silences—and 
since Pt.’s Adjustment has one of the highest 
factor loadings, we tentatively will consider 
this factor to reflect one’s “average duration 
of (mal)adjustments”; remembering, how- 
ever, that the frequency of these maladjust- 
ments (i.e., Pt.’s Synchronization), also may 
be reflected in this third factor. That Factor 
III is neither well established nor strongly 
present and thus is a weak factor, however, 
is also clear from the results.° 

In Table 2 Rotated Factor IV seems to be 
most heavily saturated with Pt.’s Initiative 
(factor loading of .50), although Pt.’s Syn- 
chronization has a loading of —.45 on this 
same factor. On replication (Table 3), the 
factor-loading for Pt.’s Initiative is cross- 
validated (.48), while that for Pt.’s Syn- 
chronization is only moderately so (—.27). 
Pt.’s Dominance, which in Table 2 had an 
insignificant loading of —.18 on this fourth 
factor, shows a significant loading of —.42 
during the second, or retest interview (Table 
3). However, since the test-retest reliability 
for measurement of the Pt.’s Dominance vari- 
able is only moderate (9, p- 273; 14, pp. 272- 
273), in contrast to the very high reliability 
for all the other variables, the full meaning of 
this finding remains unclear. Thus, in view of 
the fact that Pt.’s Initiative had the highest 
loading on Factor IV during the first inter- 
view (.50) and this was cross-validated in 
the second interview (.48), while the signifi- 
cant loadings for the other variables were not 


6 Further evidence for the tentative nature of Fac- 
tor III (and Factor IV) comes from a second factor 
analysis of the data in Table 1, done for us by W. A. 
Botzum and Charlotte David of the University of 
Portland. Using an oblique solution in contrast to 
the orthogonal solution shown in Tables 2 and 3, 
their analyses confirmed our Factors I and II, but 
indicated that Dr.’s Adjustment and Pt.’s Quickness 
had the highest consistent loadings on Factor IIT 
(the high Factor loading for Dr.’s Adjustment on 
Factor III is also present in Tables 2 and 3), and 
that, whereas Pt.’s Initiative had a high loading on 
Factor IV in the first interview, this was not cross- 
validated in the data from the second interview. 
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cross-validated by appearing in both inter- 
views, we tentatively will consider that the 
fourth factor reflects primarily the habitual 
degree of “initiative” which an S will manifest 
under conditions of planned interviewer si- 
nce. 
4j In the last column of Table 2 (and Table 
3) are shown the communalities (h?) of each 
interview interaction variable. The values in 
this column represent the amount (propor- 
tion) of the variance of each interview vari- 
able which is accounted for by our four fac- 
tors (6, p. 492). It is clear from Table 2 
(and cross-validated in Table 3) that the 
four factors which have emerged from the 
factor analysis (pt.’s “silence” behavior, pt.’s 
“action” behavior, pt.’s “adjustment” behav- 
ior, and pt.’s “initiative” behavior) exhaust 
almost the total variance of the following in- 
terview variables: Pt.’s Units (93%), Pts 
Action (85%), Pt.’s Silence (90%), Pt.’s 
Tempo (96%), Pts Activity (98%), Dr.’s 
Units (96%), and Pt.’s Quickness (93%). 
They account for the variance of Dr.’s Ad- 
justment (79%), Pt.’s Synchronization (84%) 
and Pt.’s Initiative (84%) to a slightly 
smaller extent. The variances of two inter- 
view variables are not materially accounted 
for by these four rotated factors. They are 
Pt.’s Adjustment (69%), which most helps to 
define our weak third factor, and Pt.’s Domi- 
nance (36%) which, with a cross-validated 
moderate factor loading on Factor I, and a 
noncross-validated loading on Factor IV, has 
only about one-third of its variance accounted 
for by the four factors. In view of these find- 
ings it seems safe to conclude that, on the 
one hand, more will have to be learned about 
the Pt.’s Adjustment variable and, on the 
other hand, as suggested by us in an earlier 
publication (14, p. 272), considerable error 
variance still exists in the measurement of 
our Pt.’s Dominance variable. Refinements in 
definition, or increase in the length of the in- 
terruption subperiod (for example, lengthen- 
ing it to a fixed 15 minutes rather than leav- 
ing it free as now, with an average duration 
of only approximately two to four minutes) 
may permit us to reduce the aforementioned 


7 These values more correctly should be expressed 
as proportions rather than as percentages, 
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error variance of Pt.’s Dominance and thus 
learn more about its nature. 

By squaring each row entry in each of the 
four columns of rotated factor loadings 1n 
Tables 2 and 3 and then summing down the 
columns for each of these four rotated fac- 
tors, one can obtain an estimate of how much 
of the total variance is accounted for by each 
factor (6, p. 492). Rounding off, the four fac- 
tors named at the bottom of each column ac- 
count individually for 41%, 47%, 5%, and 
7% of the total variance, respectively, in 
Table 2, and 38%, 44%, 9%, and 9%, re- 


spectively, in Table 3. It is thus clear that, — 


in terms of the Interaction Chronograph vari- 
ables so far employed by us, an S’s interview 
interaction behavior consists primarily of ac- 
tions and silences; and moderately of his 
pattern of adjustment (and synchronization) 
with the interviewer, on the one hand, and 
his degree of initiative-taking when the inter- 
viewer attempts to assess this by purposely 
remaining silent, on the other. To date we 
have not worked with Chapple’s temperament 
and personality variables (4). Although these 
represent various arithmetic combinations or 
ratios of the 12 variables shown in Table 1 
of the present paper they, nevertheless, still 
may contribute additional factors other than 
the four reported in the present paper. 


Discussion 


The results of the present study may be 
compared to the findings reported by Lundy 
in an unpublished study (7). By employing 
two therapists with one patient for 38 inter- 
views (each therapist saw the patient indi- 
vidually for 19 interviews in an odd-even 
design), Lundy was able to relate interview 
Interaction Chronograph variables to certain 
clinical impressions regarding the progress of 
psychotherapy as these qualitative data were 
assessed from the typewritten interview tran- 
scripts. In addition to demonstrating some 
interesting relationships of this type in 4 
study which used “free” psychotherapy in- 
terviewing, in contrast to the standardize 
interview employed by us (8), Lundy reports 
the results of a factor analysis of the Inter- 
action Chronograph variables for the inte- 
view interactions of his one patient with ea 
of the two therapists, Thus, as was the cas® 


P 
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ìn our study, Lundy’s use of two therapists 
with the same S enabled him to attempt to 
cross-validate his findings. One difference be- 
tween his study and ours was that we used 
60 Ss, each interviewed twice (once by each 
of two interviewers) while Lundy used one 
S interviewed 19 times by each of two inter- 
viewers. In addition, while Lundy’s Interac- 
tion Chronograph variables differed slightly 
from those used by us and described above, 
they were sufficiently similar to permit com- 
Parison, 

Lundy’s factor analysis revealed five fac- 
tors, Three of his factors were identified con- 
Sistently on replication (using his second set 
of 19 interviews). Although given slightly dif- 
ferent names by Lundy (Speed of Response, 
Amount of Therapist Talk, and Dominance) 
the first two of these are clearly similar to 
our Factors I and II; i.e., our patient’s “av- 
erage duration of silence” before he spoke 
again, and “average duration of patient ac- 
tion.” Superficially, this latter “duration of 
Patient (talk) action” factor, which we found 
as our Factor II, may differ from Lundy’s 
own Factor II, “amount of therapist (talk) 
action.” However, since our therapist was in- 
Structed always to speak in 5-second utter- 
ances, thus making the average amount of 
therapist talk a constant (5 seconds) from 
One patient to the next, there was no oppor- 
tunity for this therapist variable to reflect it- 
Self in one of our factors. 

There is good evidence (8, 
Ever, for a high positive corre 
amount of talk produced by each of two con- 
Versationalists in free conversation (such as 
in Lundy’s unstandardized psychotherapy 10- 
terviews). Thus one might hypothesize that 

ad our interviewers been allowed to talk 
freely, as did Lundy’s, and had we then re- 
corded durations of therapist actions, We also 
might have found a high factor loading for 
amount of therapist talk on our Factor II. In 
Partial support of this is Lundy's report that 
his single patient talked more with the peri 
Pist who talked more, and talked less pa 
the therapist who talked less. This positive 
covariation which Lundy reports, ae ld. 
sibly surprising, confirms our own and Gold- 
man-Eisler’s similar and independent obser- 
vation (8, pp. 357-358) and thus adds sup- 


p- 357), how- 
lation between 
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port to our belief that the reverse is also 
true; i.e., that a therapist talks more with a 
patient who talks in long utterances, and less 
with one who speaks for brief durations. If 
this is true, Lundy’s second factor and ours 
appear to be identical. 

Lundy’s third factor, Dominance, differs 
from our third factor, which we chose to call 
Pt.’s Adjustment. Since our third factor was 
the weakest, and since our earlier results have 
shown that our Dominance variable (and pre- 
sumably Lundy’s also) contains considerable 
measurement error variance, we are not sur- 
prised at the lack of agreement between our 
own third factor and Lundy’s. However, 
Lundy does report that his Pt.’s Adjustment 
variable also had a high loading on his third 
factor, and thus his third factor may be simi- 
lar to ours. 

Lundy’s two weakest and also not cross- 
validated fourth and fifth factors were Fre- 
quency of Client Response and Client Vari- 
ability. The former is similar to our Pt.’s 
Units variable and thus may be similar to 
our second factor which, as will be remem- 
bered, though called “action” by us was also 
the factor most highly saturated with our fre- 
quency, or Pt.’s Units, variable. Lundy’s last 
factor, Client Variability, is one which is 
made up of such derived or second-order in- 
dices as the variation of the first-order vari- 
ables Tempo and Activity from one part of 
the interview to another. Since to date we 
have not employed such an interview measure 
we cannot compare our results with Lundy’s 
in regard to this factor. 

The results of Lundy’s factor analysis and 
our own are interesting for one additional 
reason. Although each study was replicated, 
Lundy used one S interviewed 19 times; we 
used 60 Ss interviewed once. Interestingly, 
the results of both studies indicate that dura- 
tion of silence and duration of action are the 
most stable (and independent) factors in two- 
person communicative interactions. 


Summary 


This study employed 60 outpatient Ss in- 
terviewed under conditions of a previously 
described standardized interview. The results 
indicate that as viewed from an Interaction 
Chronograph framework, doctor-patient inter- 
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actions (and possibly most other two-person 
interactions) consist of two very stable fac- 
tors for any given individual: (a) how long 
on the average he or she waits or remains 
silent before communicating, and (b) the 
number and average duration of each of these 
communicative interactions. A third factor, 
the frequency with which one initiates or 
starts again with another communication unit 
of his own when his partner has not answered 
him, while weak, nevertheless may prove to 
be more stable as the length of time during 
which it is assessed (only during Period 2 in 
our partially standardized interview) is in- 
creased. A fourth factor, the efficiency with 
which a member of the communicating pair 
synchronizes and adjusts (or maladjusts) to 
his partner, was evident as a factor (in both 
our study and Lundy’s), but it, too, was not 
as clear-cut as were the first two factors. The 
same holds true for a weak and possibly fifth 
factor, Dominance. Doctor-patient or other 
two-person patterns of dominance-submission 
may reflect an additional important interper- 
sonal dimension and thus this fifth factor- 
variable (again measured in only one sub- 
period of our present partially standardized 
interview) will require the development of 
more refined methods of measurement, or an 
extension of the total time during which our 
dominance variable is measured. 

Further evidence for the validity, or psycho- 
logical meaningfulness, of four of these fac- 
tors (all but Pt.’s Adjustment) comes from a 
recently completed and cross-validated study 
of the psychological test correlates of our 
interview Interaction Chronograph measures 
(12). In terms of the standard psychologi- 
cal test measures (Rorschach, WAIS, Taylor 
Anxiety Scale, etc.) used in the latter study, 
different psychological test-interview correla- 
tions were found for patients who: (a) were 
high or low in their interview silences, (b) 
were high or low in their interview actions, 
(c) showed a high or low frequency of initia- 
tives, and (d) submitted to or dominated the 
interviewer. 

A second study (13), now undergoing cross- 
validation, between certain aspects of the ver- 
bal content of the interviews and the overt 
Interaction Chronograph scores, likewise has 
identified interview content (descriptions of 
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self and others) differences between patients 
who: (a) talk for long or short durations, 
(b) have long silences and corresponding high 
negative maladjustments, (c) show a high or 
low frequency of initiatives, and (d) earn 
high or low dominance scores. 

Thus it would appear that further evidence 
for the validity of the factors identified by 
our cross-validated factor analysis is coming 
from a variety of additional sources. It is out 
belief that the results of the present study 
represent merely the smallest number of fac- 
tors which can account adequately for inter- 
view interaction behavior, as this is assessed 
solely by the Interaction Chronograph. It is 
expected that a factor analysis which included 
not only intercorrelations of the 12 Interac- 
tion Chronograph variables herein used but 
also the additional intercorrelations of each 
of these variables with such other data as 
psychological test scores, interview content 
measures, Bales Interaction Process scores; 
etc. would yield still further stable interview 
interaction factors, and thus add to our 
knowledge of interpersonal behavior. 


Received July 28, 1958. 
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Problems of Reliability in Observing and 
Coding Social Interactions”? 


Allen T. Dittmann 
National Institute of Mental Health 


In observing social interactions and coding 
reports of the observations, problems of re- 
liability arise at every turn. This paper re- 
ports a series of reliability studies which have 
been carried out at the Child Research Branch, 
NIMH, where a variety of children have been 
observed in “naturalistic” settings within a 
residential treatment framework. Various as- 
pects of the findings are relevant to different 
substantive studies within the research pro- 
gram, but the reliability tests are better 
understood when presented as a whole. 

The basic data are reports of 5 to 10 minute 
observations of children in social situations, 
dictated from memory immediately after the 
observations. The protocols are coded in the 
“Circle” of interpersonal mechanisms (1) by 
pairs of coders working together. Reliability 
of coding in this paper means agreement be- 
tween two independent coder pairs, or one 
pair repeating coding with at least six months 
intervening. Reliability of observing means 
two observers reporting independently on the 
same situation. 

In judging which behaviors reported by the 
observer are interpersonal rather than self- 
directed acts, agreement is moderately high. 
Disagreements occur where the observer's 
descriptions lack detail and where the inter- 
actions involved in the acts are equivocal. 


1 An extended report of this study may be obtained 
without charge from Allen T. Dittmann, National 
Institute of Mental Health, Bethesda 14, Maryland, 
or for a fee from the American Documentation In- 
stitute. Order Document No. 5740, remitting $1.25 
for microfilm or $1.25 for photocopies. 

2The author wishes to thank D. Wells Goodrich 
and Harold L. Raush for their help throughout these 
studies, 


The reliability of coding protocols item by 
item is far greater than chance expectancy, 
and yet the degree of association is only 
moderately high. The reliability of profiles 
made up of the codings of many interactions; 
on the other hand, is very high, both in repeat 
reliability and in agreement of independent 
pairs of coders. The intensity dimension yields 
similar results: agreement is clearly beyond 
chance, but only groups of many such ratings 
can be used with confidence. 

Reports of two observers reporting on the 
same situations have also been studied. While 
there is only general agreement on individu 
acts and on the sequence of events, profiles of 
codings based on the reports are just as simi- 
lar as are those based on independent codings 
of the same reports. 

Conclusions: The reliability of these meas- 
ures is analogous to that of tests. Items of low 
reliability may be combined to yield tests 0 
high reliability. Where profiles of individuals 
or groups are to be compared, the system We 
have used is very adequate. Where sequences 
of individual acts are to be studied, howeve! 
as in the details of symptomatic behavior, th® 
number of sequences must be large enous 
that the low item reliability does not detra¢ 
from any generalizations drawn from the find 
ings. ° 
Brief Report. 
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Environmental Factors and Outpatient Clinic Intake 


Marvin Hyman and Julian Wohl 
VA Mental Hygiene Clinic, Detroit 


ah everyday functioning of a mental 
can aa clinic or agency, marked fluctuations 
Presen observed in the number of people who 
ach themselves for the available services. 
is = ne develops its own explanation for 

| eee with the result that there 
Ses to = exists a number of untested hypothe- 
ae variations in daily intake. These 
e eses are varied and sometimes colorful. 
a have heard explanations that 
and w esize relationships between daily intake 
omb cather conditions, unemployment, atom 
Althou explosions, crime rate, sputniks, etc. 
ested gh these hypotheses have been un- 
Produ in the main, they are nevertheless the 
ake of observations of experienced clinical 

It ts and deserve some evaluation. f 

Y aE purpose of this study to examine 
ions latically the daily and monthly varia- 
em in the number of persons who present 
abe for mental hygiene services and to 
Rilstea i the possible relationships that 
tain cli between these variations and (a) cer- 
Aspect, imatological conditions and (b) onan 
Cally S of the employment situation. seed 
a) d the following hypotheses were teatea 
ing t aily intake varies systematically accord- 
e © the day of the week and the month © 
alee (b) daily intake is related to ied 
Preci ological conditions, €-8» temperatur 4 
;. !Pitation, sunshine, etc., (c) daily intake 


is co. à} : 
te ed with the rate of local unemploy 


I . 
n order to test the foregoing hypotheses, 


Sa daily intake of the Detroit VA Mental 
“aa Clinic for the year 1956 was ee 
fica ake was defined as the number of in- 
ay uals presenting themselves 0n 4 ae 
etyi without appointment, for the vado, 
Ices offered by the clinic. Patients wi? 


were seen on the basis of regularly scheduled 
appointments were not included in the count. 

From information supplied by the U. S. 
Department of Commerce Weather Bureau 
(1), it was possible to select three variables 
which grossly reflected weather conditions on 
a particular day. These were: Average tem- 
perature, total precipitation, and percentage of 
possible sunshine. 

The Michigan Employment Security Com- 
mission ? supplied two indices of the employ- 
ment situation in the Detroit Metropolitan 
Area for 1956: Total unemployment estimate 
(by months) and the number of claims filed 
for unemployment compensation (by weeks). 


Results 


In 1956 there were 252 working days. The 
median intake over the year was 7.43 patients 
Reference to Table 1 reveals that 


per day. 
heavier intake (more than seven patients) 
Table 1 
Chi Square Test of Intake Variation by 
Day of the Week 
Day of the week 
LEO TEA eee 
Intake M OD WV hee 


15: 20 37 2828 


Under the median 
o 34, 31. 12, 0231 24 


Over the median 


Note—Chi square = 23.238; df = 4; = .001. 
was most likely to occur on Mondays, and 
least likely on Wednesdays. Similarly, refer- 
ence to Table 2 indicates that heavier intake 
days were most likely to occur in the months 
of September, November, and March; and 


1 Personal communication. 
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Table 2 
Chi Square Test of Intake Variation by 
Month of the Year 
Number of working days 
intake was— 
Under Over 
Month median median 
12 9 
n. 

ve. 13 7 
Mar. 8 14 
Apr. 8 13 
May 11 11 
June 15 6 
July 17 4 
Aug. 14 9 
Sept. 3 16 
Oct. 13 10 
Nov. 6 14 
Dec. 11 8 


Note.—Chi square = 30.281; df = 11; p = .003. 


were least likely to occur in the months of 
June, February, and December. 

The effect of weather conditions upon in- 
‘take was submitted to chi square analyses with 
the following results: Temperature was re- 
lated to intake in a curvilinear fashion, i.e., 
heavier intake tended to occur on those days 
‘of the year when the temperature was mod- 
‘erate (second and third quartiles of the tem- 
perature distribution) and was least likely 
when it was very cold or very warm (first and 
fourth quartiles). The chi square was 4.036 
with 1 df, p = .04. The presence or absence of 
rain, snow, and/or sunshine seemed not to be 
significantly related to intake. 

The analysis of the relationship between 
intake and conditions of employment revealed 
that intake is unrelated either to the num- 
ber of unemployed during the year (rho = — 
.04), or to the number of claims for unem- 
ployment compensation that are filed (rho = 
02). 

We suspect, but have no data to support 
this, that Monday is the heaviest intake day 
because of a backlog of applicants which ac- 
‘cumulates over the weekend. Another guess is 
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that Wednesday typically has few intakes be- | 
cause of a phenomenon peculiar to Detroit. £ 
On that day in Detroit most physicians do not 
maintain office hours and private clinics are 
closed. We would guess that the community 
has generalized from this fact and lives as if it 
applied to the VA Clinic. 

The mythology of the outpatient clinic has 
suggested that unemployment in an industrial, } 
one-industry area would affect intake activity 
in an outpatient mental health agency. The 
agency, so runs this argument, deals primarily 
with marginal people of low socioeconomic 
class who would be more likely to come to the 
agency when times get hard. Although it 15 
true that the clinic population is comprise 
largely of individuals from low socioeconomic 
classes, the results of this study show that 
whatever accounts for fluctuation in requests 
for clinic services, it is not the labor situation. 
Like the U.S. mail, our clientele was not dis 
couraged by rain, sleet, snow, or hail, although 
when the weather became very hot, it tended, 
unlike Noel Coward’s Englishmen, “to stay 
out of the midday sun,” and when it was ¢%* 
tremely cold, wisdom overcame anxiety, an 
the clients remained close by what passed fot 
their firesides. | 

From these results, it can be concluded that, 
by and large, the applicants for the services 
of this clinic come because of needs for help 
which are not based on situational factor 
such as unemployment and weather conditions 


Summary 


This study tested the hypotheses tba! 
weather and employment conditions affecte 
the applications for treatment in a VA menta! 
hygiene clinic. With some exceptions, the 0D” 
tained data did not support these hypothes¢* 


Received November 15, 1957. 


Reference 


1. U. S. Department of Commerce, Weather Buren 
Local climatological data (monthly reports | 
Washington, D. C.: U. S, Government PA” 
ing Office, 1956, 


Journal of C, n 
Vol. 22, A coag Psychology 


A Factor Analysis of Indices from Four Projective 
Techniques Associated with Four Different 
Types of Physical Pathology 


Claire M. Vernier 
Veterans Administration Hospital, Baltimore, Maryland 


John W. Stafford 


Catholic University of America 


and Arnold D. Krugman 


Veterans Administration Center, 


The analysis to be reported represents & 
ey approach to two current clinical prob- 
a (a) statistical validation of relation- 
hips among specific projective test scores OF 
hee and (b) measurement of relationships 
between psychological variables and different 
ypes of medically diagnosed physical pathol- 
ogies. 

Both of these somewhat more theoretical 
questions were derived from an immediate 
Practical problem of the need for a set of 
rigidly definable and defensible bases for the 
identification of specific test variables to be 
used in a comparison of significant psycho- 
logical differences between two groups of 
a” physically handicapped male veterans 


While several factorial studies of projective 
techniques have been reported in the litera- 
ture, these analyses have been directed pri- 
Marily to the structure of a given test rather 
than to the intertest factorial composition 0 
individual psychological variables. Thus, there 
are Guertin’s analyses of the Szondi and 


Bender-Gestalt (4, 5, 6, 7 8, 9) and the 
studies of the Rorschach (1, 2, 10, 11), but 
have been 


as far as the authors know there i 
no factor analysis studies reported of variables 
from more than one projective technique. 
The literature describing relationships be- 
tween physical pathology and personality 


Martinsburg, West Virginia 


functioning is vast. Extensive efforts have 
been made to demonstrate personality types 
associated with particular physical disabilities. 
In less intensive fashion, a great deal of work 
has occurred describing the relationship be- 
tween kind of disability and adjustment to it. 
Numerous papers have appeared regarding 
prediction of specific behaviors in the areas of 
hospital adjustment, response to medical treat- 
ment, or posthospital adjustment. However, 
in none of these reports were medical and psy- 
chological data integrated into a correlational 
matrix and factored. 

Therefore, the major purpose of this study 
was to verify by means of multiple factor 
analysis, the relationships among the projec- 
tive test scores and signs previously considered 
to be measures of seven specific psychological 
variables. A secondary purpose was to deter- 
mine, also by means of multiple factor analy- 
sis, the relationships among four types of 
physical pathology and these same projective 


test scores. 
Procedure 


The total sample consisted of 105 male 
members of the VA Center, Martinsburg 
West Virginia Domiciliary and 45 equally 
physically disabled male veterans residing in 
West Virginia who had never applied for ad- 
mission to any VA Domiciliary or similar type 
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Table 1 
Variables Included in Initial Correlation Matrix 
Variable Test Definition Variable Test Definition 
jective tests: 26" Rorschach Total score of shading 
A. Test Scores from the four projec ae GHG: dimensional 
Withdrawal perspective (k) 
1* Bender-Gestalt Upper 14 or left mar- 27 Bender-Gestalt Erasures present M 
gin placement of all one or more figures 
eTa ne P 28 Bender-Gestalt Retracing og ae 
2  Bender-Gesta ; 2 a b, K one or more fi 
3 circles straight 29% Person Drawing Person drawn as off- 
or left slanted, not balance 
Drawi on fitted 30 Sentence Completion Total score need-de- 
3 Person Drawing ands om fendance 
4° Rorschach Total % human con- Depression F 
m EN — 31 Rorschach Sum of achromatic 
5 Rorschac! sum color l c 
i (@FC+1CF+1.5C) 32" Bender-Gestalt Figure ¢ 7 horizon- 
6 Sentence Completion ‘Total (pksie-cejection tal slanted down to 
i ian right 
7 Sentence Completion Total seed-afliation 33 Bender-Gestalt Hee #3 rotate 
i : n down (45° to 225 
8* Sentence Completion Total need-infavoid- 34° Bender-Gestalt Figure #6, horizont 
E Activit areas curve slanted down 
nergy or Activity to right 
9 Person Drawing Legs or arms uneven Dependency-Passivity s 
10 Rorschach Ba ah or width 35 Rorschach Total sum of oral con- 
orscha otal animal move- tent 
ment score (FM) 36* Bender-Gestalt Figure #7, left side 
11" Rorschach Total sum of large de- rotated down 
tails (D) 37* Person Drawing Center line of buttons 
12* Bender-Gestalt Figure #6, 1} times indicated 
or more enlarged 38* Sentence Completion Total score press-nur- 
13*  Bender-Gestalt Figure #8, 1} times turance 
or more enlarged 39 Sentence Completion Total score need-pas- 
Feelings of Invalidism aoe , sivity 
14 Rorschach Total animal object 0" Sentence Completion Total score need-suc- 
content score Ambiti corance 
15 Rorschach Total i x og 
rma con 41 Rorschach Total sum of small 
details (d) 
i eee ‘ae consent 42* Rorschach Total a of re 
17 Rorschach Total s sponses (R) J 
: el comet 43 Rorschach Eagle or emblem one 
18 Person Drawing Unseeing eye (drawn tent eee! in on! 
as empty circle) 44 Person Drawing niare e ae doth- 
19 Person Drawing Body shading other ae A Aera renent 
í a ing details 
he = he ee 45 Sentence Completion Total score need- 
p i p achievement 
20 Person Drawing Ta = ne 46 Sentence Completion Total score need- 
21° Person Drawing Legs omitted 47" Person Drawing Pe ig vi 
22 Sentence Completion Press-physical lack ee Oe 
+ Other Variables: 
Anxiety (Tension) 48 i 
23 Rorschach Total number of cards 49 baile pathology present 
å rejected 50 Respir. atory pathology present 
24 Rorschach Total score of inani- $ bier Pathology present 
mate movement (m) 2 T ae logical pathology present ‘ 
25 Rorschach Total score of diffe ares from group-administered Otis 
shading (K) S oe termediate level, Form A 


sical fitness test score 


a an ieee NE 


a Variables subsequently dropped from the fact 
b As specifically defined 


tissue, etc. 


concepts of physical di 


€ Except when part of a total stick (line) figure. 


or analysis matrix, 
lestruction or decay, 


y 
such as germs, rotten tree, corroded by rust, eaten awe 


ee 


Factor Analysis of Four Projective Techniques 


cman living Each subject had a 
hef medical diagnosis of one or more of 

À ollowing four disease processes: ortho- 
Pedic, as verified by X-rays; respiratory, 
as verified by X-rays and other laboratory 
studies; cardiac, as verified by both electro- 
cardiograph and blood studies; neurological, 
as verified by either spinal tap or electro- 
encephalogram. Incidence of pathology for 
the total sample of 150 cases was: orthopedic, 
43%; respiratory, 28%; cardiac, 3870; neu- 
rological, 16%. 

A completed battery of the following five 
Psychological tests, group administered, was 
available for each of the 150 cases: Otis S.A. 
Test of Mental Ability, Intermediate Exami- 
nation, Form A; Bender-Gestalt figure draw- 
ings (from slides); Rorschach; Drawing of 
a Person; and the Rhode-Hildreth Sentence 
Completion Test. One other measure also 
available was a quantitative score of physical 
fitness capacity derived from a performance 
test developed by the Chief of Physical Medi- 
cine and Rehabilitation (3). 

From the four projective tests 47 scores 
were selected which, on the basis of previous 
studies and of clinical experience, presumably 
reflect personality variables of significance in 
relation to the comparison of differences be- 
tween the Domiciliary members and the com- 
munity control sample. Such variables in- 
clude: withdrawal, energy; feelings of invalid- 
ism, anxiety, depression, dependency passivity, 
and ambition. Table 1 summarizes the 53 
variables in the original correlation matrix. 

Tetrachoric correlations were computed 
among all of the 53 variables. In the case of 
quantitative test scores, the median was use’ 
as the cutting point. In order to have a matrix 
of a size more feasible to factor, 18 of the 47 
Psychological test scores were dropped either 
because of essentially zero correlations or cor- 
relation coefficients above 75, with one OF 
more of the variables included. 

The 35 x 35 matrix was factored by the 
Thurstone Complete Centroid Method. The 
factor loadings, after ten oblique rotations, 
are given in the following section. A cutting 
1The community control growl i e eee 


through the cooperation of the West V 3 
Board of Vocational Education, Division of Voca- 


tional Rehabilitation. 
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point of +.35 has been used, except in three 
cases where the pattern of correlations seemed 
to justify going down to .32 or .33. Listed 
first are the variables loading uniquely on the 
given factor; then are listed, with the variable 
number in parentheses, those variables load- 
ing + .35 or above on other factors also. 


Results 
Factor A 
No. Variable Loading 


3 Hands omitted (Person Drawing) 63 


7 Need-affiliation (Sentence Completion) —.49 
[23] Card rejections (Rorschach) —.64 
[17] Dysphoric responses (Rorschach) 353 
[20] Single line legs or arms (Person 

Drawing) — 46 
36 


[51] Neurological pathology present 


On the basis of the two test variables which 
ignificant loadings for this one factor 
Factor A is tentatively identified as a 

variable. The significant posi- 
for neurological pathology pres- 
h clinical observations. 


have s 
alone, 
“withdrawal” 
tive loading 
ent is consistent wit 


Factor B 


No. Variable Loading 

27 Erasures (Bender-Gestalt) AD 
22 Press-physical lack (Sentence Com- 

pletion) —.47 
[51] Neurological pathology present : .72 
[30] Need-defendance (Sentence Completion) 68 
[9] Uneven legs or arms (Person Drawing) 55 
t (Rorschach) = 54 


Anatomical conten 


High inanimate movement (Rorschach) 54 


Factor B is tentatively identified as a “ten- 
» factor. The negative loadings for two 
scores usually interpreted as methods of 
defense against anxiety [22, 15] would be 
consistent with this hypothesis. 


sion’ 


Factor C 

No. Variable Loading 
53 Physical fitness test score 60 
44 ‘Additional details (Person Drawing) AL 
41 Small details (Rorschach) 37 
6 Press-rejection (Sentence Completion) 33 
[43] Eagle or emblem content (Rorschach) 59 
[46] Jeed-recognition (Sentence Completion) — .56 
[20] Single line legs or arms (Person Drawing) —.47 
[23] Card rejections (Rorschach) = 
[9] Uneven legs or arms (Person Drawing) —.41 
[35] Oral content (Rorschach) AL 


The combination of variables with signifi- 
ficant loadings on Factor C would suggest a 
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tentative identification as “needs for social ap- 
proval or attention” rather than either energy 
or ambition. 


Factor D i 
No. Variable Loading 
25 Diffuse shading (Rorschach) 32 
[19] Body shading (Person Drawing) 
[28] Retracing (Bender-Gestalt) 6 
[15] Anatomical content (Rorschach) —.56 
[49] Respiratory pathology present —.50 


Factor D would appear to be an “anxiety” 
factor as differentiated from “physical ten- 
sion” reflected in Factor B. 


Factor E 3 

No. Variable Loading 
39 Need-passivity (Sentence Completion) 39 
[51] Neurological pathology present 93 
[28] Retracing (Bender-Gestalt) : 60 
[30] Need-defendance (Sentence Completion) 60 
[19] Body shading (Person Drawing) AL 
[43] Eagle or emblem content (Rorschach) AL 

[9] Uneven legs or arms (Person Drawing) 39 
[17] Dysphoric responses (Rorschach) 38 


On the basis of the variable with the high- 
est unique loading for Factor E, it is tenta- 
tively identified as “dependency-passivity.” 


Factor F 
No. Variable Loading 
5 High weighted sum color (Rorschach) th 
16 Plant content (Rorschach) 42 
[9] Uneven legs or arms (Person Drawing) —.46 
[49] Respiratory pathology present —.34 


Factor F is possibly an indication of affec- 
tive lability. 


Factor G 

No. Variable Loading 
§2 IQ 73 
2 Figure #2, straight or slanted to left 45 

(Bender-Gestalt) 

50 Cardiac pathology present 44 
10 High animal movement (Rorschach) Al 
[19] Body shading (Person Drawing) .65 
[24] High inanimate movement (Rorschach) 43 


The combination of variables with signifi- 
cant loadings on this factor is clinically in- 
teresting as well as puzzling to some extent, 
One hypothesis is that there may be a kind 
of system of pseudo-intellectual defenses avail- 
able to persons with better than average in- 
telligence. 


Claire M. Vernier, J. W. Stafford, and A. D. Krugman 


There were five variables, 18, 31, 33, 45, 
and 48, which had no significant loading on 
any of the seven factors. 

The seven factors were intercorrelated. 
Most of the correlations were low and nega- 
tive. Only two, between B and E (—.49) and 
between C and F (—.44), were above .35. It 
is, therefore, quite unlikely that any second- 
order factors would be found. 


Discussion of Results 


The factor structure that emerges from the 
oblique rotations appears to be fairly well 
defined. Of the originally postulated seve? 
Psychological variables for which projective 
test scores were selected, three were relatively 
easily identifiable as factors, namely: with- 
drawal (Factor A), anxiety (Factor D), and 
dependency-passivity (Factor E). Four of the 
postulated psychological variables did not 
emerge as factors, depression, ambition, en- 
ergy, and feelings of invalidism. While it is 
Possible that adequate projective test indices 
of these variables were not included in the 
factor matrix, it is of interest that three some- 
what related factors were identified: affective 
lability (Factor F), needs for social approval 
or attention or prestige (Factor C), and 
pseudo-intellectual defenses (Factor G). Not 
previously anticipated was the appearance of 
a physical tension factor (Factor B) as dif- 
ferentiated from an anxiety factor. 

It can be noted that neither a test nor 4 
medical pathology type of factor structure 
was found. That is, there was not found 4 
series of factors each loaded with indices from 
a single test, or four factors each with one 
medical pathology variable showing a hig 
loading. The pattern of factor loadings fot 
the four types of medical pathology would be 
consistent with the theory that personality 
variables are not associated with specific types 
of physical disease. It may very well be that 
the personality variables are related to kinds 
of reaction to illness or ability, although this 
can not be concluded from evidence in 
Present study. 

_ We find that orthopedic pathology has a 
significant loadings on any of the seven fat- 
tors; respiratory pathology has negative 102 
ings on Factors F and D; cardiac patholo 


Factor Analysis of Four Projective Techniques 


shows a positive loading on Factor G; neu- 
rological pathology has high loadings on Fac- 
tors A, B, and E. 


Summary 


Forty-seven scores or indices were selected 

from four different projective tests and inter- 
correlated; also included in the correlation 
matrix were medical diagnoses of four types 
of physical pathology, IQ score, and a score 
of physical fitness capacity. Eighteen of the 
test scores were eliminated, either because of 
zero correlations or very high correlations 
with other variables, and the remaining 35 X 
35 matrix factored. 
__ Seven factors emerged which are tentatively 
identified as: withdrawal, physical tension, 
needs for social approval or prestige, anxiety, 
dependency-passivity, affective lability, and 
pseudo-intellectual defenses. The factor struc- 
ture seemed unrelated to either the kind of 
test or the type of medical pathology. 

Presence of orthopedic pathology did not 
show a significant loading on any of the seven 
factors. Respiratory pathology present had 
significant loadings on not labile and not 
anxious. Cardiac pathology present showed a 
Significant loading on intellectual defenses; 
neurological pathology present had high load- 
ings on withdrawal, physical tension, and de- 
Pendency-passivity. 

The results of the ana 
indicate a partial validati 
clinical interpretations made from selected 
projective test variables and to support the 
hypothesis that personality factors are not 


lysis would tend to 
on for some of the 
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associated with specific types of physical 
disease. 


Received June 9, 1958. 
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A number of studies have pointed to the 
impact of the “schizophrenogenic” parents, 
especially mothers (eg., 3, 5, 8, 12, 16, 17, 
18, 19), and other studies are indicative of 
pathological configurations in Rorschach re- 
sults of relatives of schizophrenics (e.g., 13, 
14). Further examination of the proposition 
that pathology can be discovered in the 
Rorschach performances of mothers of schizo- 
phrenics is in order. Such mothers are ex- 
pected to show relatively severe manifesta- 
tions as compared with mothers of nonschizo- 
phrenic offspring. 

In 1950, Prout and White published one of 
the few studies in which there was a com- 
parison of reasonably well matched groups of 
mothers of schizophrenics and mothers of non- 
schizophrenics. Prout and White studied, by 
means of personal interview, the dominant 
orientations of all these mothers toward their 
sons in such areas as child-rearing attitudes 
and also recall of the various actual events 
and adjustments of the growing child. Addi- 
tionally, a Rorschach test was administered 
to each mother in an effort to learn some- 
thing about her personality pattern. Essen- 
tially, the findings of Prout and White were 
these: (a) the mothers of the schizophrenics 
seemed to be overprotective and overcon- 
trolling in contrast to the control mothers, 
(b) the experimental mothers had somewhat 
higher and more unrealistic levels of aspira- 


1We express our gratitude to C. T. Prout and 
Mary A. White, of the New York Hospital, West- 
chester Division, White Plains, New York. Their 
data and cooperation made the study possible. 


tion for their sons and subordinated the hap- 
Piness of the child to such considerations, 
(c) yet, paradoxically, their demands on their 
sons were somewhat less explicit than the 
demands made by the control mothers, and 
(d) clinical assessments of the Rorschachs me 
dicated that the experimental mothers mani- 
fested more pathological personality configu- 
rations. 

It is this last finding which Jeads to the 
effort to make a more particularistic state- 
ment of the difference in Personality charac- 
teristics, based on the Rorschach perform- 
ances of these two groups of mothers. The 
Prout and White data can be utilized in 4 
test of the hypothesis that the “level of per- 
ceptual organization” aspect of the complex 
pathology called schizophrenia is more evi- 
dent in the mothers of schizophrenics tha? 
among mothers of normals. 


Method 


The Prout and White sample consisted of 
50 women, half of them being the exper” 
mental group who were mothers of young 
adult males diagnosed as schizophrenic, a”! 
the other half consisted of a control group ° 
mothers of normal sons, In general, Prou 
and White made the two groups comparablé 
on several usual matching variables. How’ 
ever, there were some differences in chrono” 
logical age and about one-third of the €% 
perimental mothers had been born in fo” 
eign countries, The Rorschach protocols wer? 
coded by White and sent to the present 3" 


438 


x 
t 


Rorschach Maturity Scores of Mothers of Schizophrenics 


thors who rated each protocol for “personal- 
ity-age-level.” 

“Personality-age-level” ratings are based on 
the viewpoint that the Rorschach perform- 
ance can be scored for maturity of personal- 
ity development by rating the protocol on a 
scale (a five-point scale in the present study) 
on which points are defined by the average 
Perceptual organization levels of successive 
Tepresentative chronological age groups be- 
ginning with very young children and ex- 
tending to the adult group. In other words, 
it is assumed that the level of organization 
of Rorschach responses is associated with the 
level of organization of adjustment in life. 
Since the rating points are defined in terms 
of average Rorschach performances, the defi- 
Nitions of rating points are limited by the 
adequacy of normative data. In the present 
study, norms relied upon included those of 
Halpern (6), Kay and Vorhaus (9), Klopfer 
and Margulies (10), McFate and Orr (11), 
and Cass and McReynolds (2). 

After each judge had rated every protocol 
(there were 25 experimental and 23 control 
records available), the key to the code was 
obtained and the statistical tests for differ- 
ences between the two groups of mothers 
were made. 


Results 


The judges were permitted any gradations 
between 1 and 5, or in other words were not 
required to use only the points 1, 2, 3, 4, or 
5. The product-moment correlation between 
the two sets of judges’ ratings is 83. A mean 
rating based on the two judges’ ratings = 
each protocol was adopted as the best avail- 


able score, On the five-point scale where 5 is 
d 1 is the most ma- 


the most immature an : 
ture, the mean rating for the experimental 


m i d that for normals is 
The. diference means yielded a ¢ 


The difference between : 
of 3.08, p < 01. There is considerable oyei 
lap of the groups, as is Taking 

median of the combined groups asa rg 
point, 10 mothers of schizophrenics an bs 
mothers of normals are above, and 15 ~ 

ers of schizophrenics and 9 mothers of nor- 


mals are below, the median. 


tings, 4 chi- 
For each of the two sets of ra j 
ionship between group 


square test for relati! 


expected. 
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and rating was made. The four rating cate- 
gories of the 2 X 4 chi-square table were the 
quartiles of the combined distribution of the 
48 ratings made by each judge. For one 
judge, the chi square was significant between 
the .02 and .01 levels. For the other judge, 
the significance level was between .05 and 


02. 
Discussion 


Since there is a statistically significant dif- 
ference between the mean age-level ratings 
for the experimental and control groups, it is 
concluded that among mothers of schizo- 
phrenic sons there is a disproportionate num- 
ber who manifest pathology. This pathology 
is tentatively defined as immaturity of per- 
ceptual organization. It is assumed that this 
immaturity is associated with detrimental de- 
velopmental conditions and is manifest in 
pathogenic conduct in parent-child relation- 
ships which has contributed significantly to 
the schizophrenic reactions of the sons. 

Since the distributions of the highly reli- 
able ratings show considerable overlap, it is 
assumed that the experimental mothers are 
only quantitatively deviant from the cultur- 
ally normal range of conduct. Several moth- 
ers of nonschizophrenic sons manifest severe 
pathology. Their less debilitating effect is ex- 
plained on the basis of assumed compensatory 
relationships of their sons with others. As 
some experimental mothers manifest mini- 
mal pathology, alternative hypotheses must 
be invoked to account for the development of 
schizophrenic reactions in these sons. 

The approach used in evaluating the Ror- 
schachs is apparently very similar to a sys- 
tem developed at Clark University and re- 
ported by Friedman (4), Siegel (18), Wyatt 
(20), Pena (15), and Hemmendinger (7). A 
used by Becker (1). Since 
the direct comparison of scoring one set of 
protocols by all of these methods was not 
carried out, no firm conclusion is justified, 
as yet, regarding the comparability of such 


similar system was 


scores. 
Summary . 


Rorschach protocols of 48 women, 25 of 
whom were mothers of young adult male 
schizophrenics and 23 mothers of normal 
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sons, were scored for personality-age-level, 
i.e., maturity of personality. F 
i Within the limitations of this study, the 
following conclusions are drawn: d 
i Personalia geene] Rorschach scoring 
can be done with good reliability. , . 
2. As a group, mothers of schizophrenic 
sons manifest more pathology than a group 
of mothers of normal sons. 
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Rorschach Card Rejection by Psychiatric Patients’ 


Arthur S. Tamkin* 


Veteran. 


There is a great deal of inconsistency in the 
Rorschach literature among statements about 
the incidence of Rorschach card rejection 
within the various nosological groups and 
about the determining factors proposed to ac- 
Count for it. In Rorschach’s (6) discussion of 
the incidence of rejections he stated that nor- 
mal subjects almost never fail to give a re- 
sponse, while neurotics occasionally reject, 
and schizophrenics f requently reject the cards. 
He attributed the neurotic’s failure to respond 
to “inhibitions due to complexes.” Beck (1) 
considered rejections to result from “fearful 
needs for certainty,” and he regarded them as 
an indication of defensive behavior, the sub- 
ject thereby trying to shut off either affect or 
intellect, In the schizophrenic, however, he 
considered them as symptomatic of regression. 

Klopfer and Kelley (3) observed that there 
were differential rejection rates associated with 
the various cards. They stated that Card IX 
was the only one frequently rejected by nor- 
mal subjects, with Cards II and vI next in 
order of frequency. It was their belief that the 
rejection of Cards II, IV, VL and IX has less 
pathological significance than rejection of the 
other cards, that neurotic subjects usually re- 
ject these cards, and that the rejection of more 
than four cards poin psychotic a 
order. They proposed that while the general 
significance of rejection is 
sistance against the situation, 
from a variety of causes such as 


1 From the VA Hospital, Northamptori, ee T 
author is appreciative of the help 0° the PIPE psy- 
of this report given by the staff ofthe Sen k Dnt 
chology Service and by i tie Uni- 
versity and Maria Rickers 
versity of Connecticut. 5 7 
2Now at ihe Columbus Receiving Hospital for 
Children, Columbus 19, Ohio. 


s Administration Hospital, Northampton, Massachusetts 


or emotional incapacity to cope with the situa- 
tion or an aggressive negativism. 

Using the group Rorschach method with 
psychiatric patients to explore favorable prog- 
nostic indications, Scherer (7) found that 
Rorschach card rejection was inversely related 
to spontaneous remission, and that there were 
trends for patients who showed the least num- 
ber of rejections to be the ones most likely to- 


improve from electroconvulsive therapy and 


lobotomy. He also found that two weeks after 


lobotomy, rejections decreased in both indi- 
vidual and group methods of administration 
(8). In the context of these studies, rejection 
was considered to signify withdrawal from the 
immediate environmental situation and a de- 
crease in the strength of ego boundaries. 

It is understandable that inconsistent opin- 
ions might arise because of the absence of 
relevant statistical data. However, recent 
studies reporting empirical data on rejection 
by psychiatric groups show considerable agree- 
ment and elucidate the actual incidence of re- 
jections. In Mensh and Matarazzo’s study (4) 
of 201 hospital patients, it was found that 
19% of their psychotics, 24% of the neu- 
rotics, and 37% of the organics rejected one or 
more cards. These values were not signifi- 
cantly different from each other according to: 
the chi square test. Rejections occurred pri- 
marily in response to Cards IX, VI, VII, X,. 
and IV, which provoked 83% of all rejections. 
In a cross-validation study, Sisson, Taulbee, 
and Gaston (9) found that within their sub- 
ject groups, rejections were elicited from 
33.3% of the neurotics, 32.0% of the schizo-- 
phrenics, 17.4% of the normal adults, 10.0% 
of the normal children, and 22.7% of the 
mentally defective children. These differences 
were significant for comparisons within the: 
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adult groups and the juvenile groups, with = 
exception that the percentages of rejections y 
the neurotics and the schizophrenics vg = 
significantly different from each other. V em 
all groups were matched for age and aa er 
of responses, the only significant di a 
with respect to the rejection data was m 
more frequent rejection of Card X pa e 
schizophrenics than by the normals. 3 ey 
concluded that although Rorschach card re- 
jection has little or no diagnostic significance 
in terms of the common nosological categories, 
it might be related to personality variables 
which cut across the broad diagnostic clas- 
sifications. It was to explore this possibility 
that the present study was designed. 


Method 


Rorschachs of 109 psychiatric patients at 
the Northampton Veterans Administration 
Hospital for whom concurrent MMPI data 
were also available were randomly selected 
from the files for use in this study. Rejection 
was defined as the failure to offer a scorable 
response to any Rorschach card during the 
performance proper, and the specific cards 
eliciting a rejection were recorded for each 


subject. The personality variables investigated 


as determinants of rejection were defensive- 
ness, psychasthenia, 


depression, pathology, 
and psychiatric diagnosis. The first three traits 
were suggested as Promising variables in view 
of their advocacy by 


other investigators as de- 
terminants of item omission on the MMPI 


Table 1 


Frequencies and Percentages of Neurotics and 


Psychotics Rejecting Rorschach Cards 

Neurotics Psychotics 

Number (V=37) (V=59) 
of cards a mee 
rejected No. % No. % 
0 21 56.8 34 57.6 
1 5 13.5 12 20.3 
2 4 10.8 7 11.9 
3 4 10.8 3 5.1 
4 1 2.7 1 1.7 
5 2 5.4 2 3.4 

6-10 o o0 o 0 


Note.—The Kolmogorov-Smirnoy two-s: 


ample test shows no 
significant difference at the .05 level between the two percent- 
age distributions, 
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Table 2 


Frequencies and Percentages of Neurotics and 
Psychotics Rejecting Individual 
Rorschach Cards 


Neurotics Psychotics 
(N=37) (N =59) Total 
Rorschach 
Card No. % No. % No. % 
I 0 0 3 Bl 3 3 
II 6 16.2 3 51 9 si 
II 2 54 1 4127 3 33 
IV 3 81 5 85 8 F 
v 1 27 4 68 5 13 
VI 3) 81 8 13.6 11 p 
VII 10 27.0 G 10.2 16 t 
VII 2 54 T Sa a, 
IX 7 189 9 15.2 16 ao 
x G Tas 7 119 12 12. 


Note.—Critical ra 
ence between percen 
.05 } 


a o differ- 
tio tests for the significance of the ai the 
tages showed a significant difference 4 
evel only for Card VII, the CR being 2.06. 


(10), a type of test behavior presumed to K 
the “objective” test counterpart of Rorschac 
card rejection. These traits were representor 
by the following scales of the MMPI: i 
not Say,” K, L, Pt, and D. The F scale W a 
taken as the measure of pathology, and psy E 
chiatric diagnosis was either neurosis Or pa 
chosis (predominantly schizophrenia) P 
ously established by a diagnostic contea 
for a subgroup of 96 patients. All M 
scales were dichotomized at their respect,” 
medians, and Rorschach rejection was ot 
chotomized on the basis of its anses ; 
presence. A series of two by two contine a 
tables was drawn up, and chi square i 
Were computed separately for each measure: 


Results 


None of the chi square tests for the relation 
ship between Rorschach card rejection ane 4 
various Personality traits reached an aeee 
able level of statistical significance, nor ee 
any trends even apparent, Of the neurotic 5 e 


sample (V = 37), 43.2% gave one Or 

Peis: BAN: — 59) 
rejections, and of the psychotics (V = cies 
42.4% did 


So. Table 1 shows the frequen 


iffet 


-sample test for p ps $ 
i percentage distribu A 
failed to reach the -05 level of significant 


j 
mor 


ee a ii 
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Rorschach Card Rejection by Psychiatric Patients 


Table 2 shows the frequencies and per- 
centages of neurotics and psychotics rejecting 
each individual Rorschach card. Tests of the 
significance of percentage differences for each 
card showed that only for Card VII was the 
difference significant at the .05 level, the 
Critical ratio being 2.03. The significance of 
this finding vanishes, however, since one out 
of ten computed statistics attaining the .05 
level could result from chance. 


Discussion 


This attempt to identify personality traits 
associated with the tendency to reject Ror- 
Schach cards failed to find significant rela- 
tionships. Although the omission of MMPI 
items was thought to be the “objective” test 
Counterpart of Rorschach rejections, this be- 
lief was unsupported by the data. In agree- 
ment with other studies (4, 9), it was found 
that nosological groups (neurotics and psy- 
chotics) rejected essentially the same number 
of cards with comparable frequencies for 
given numbers of cards and for specific cards. 
The very close consistency with the findings 
of the other empirical studies with respect to 
the differential rejection rates evoked by par- 
ticular cards is illustrated by Table 3. This 
table compares the independently obtained 
Orders of the five most frequently rejected 
cards, arranged from highest to lowest in rate 
of rejection. 

It may be seen that a 
frequently rejected cards, 


VII are common to the fi f 
investigators. It is of considerable interest to 


note that Sisson’s normal group is also in- 
cluded in this communality. Closely related 
to these stable differential rejection rates are 


mong the five most 
Nos. IX, VI, X, and 
ndings of all three 
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the reported observations of initial reaction 
times. Phillips and Smith (5), presenting data 
from 59 normal males ranging in age from 20 
to 40 years, showed the following order of the 
five cards eliciting the longest response latency: 
VI, IX, II, X, and IV. Similarly, Beck et al. 
(2) showed the order which they obtained to 
be: IX, VI, X, IV, and II. The overlap be- 
tween the five most rejected cards and the five 
cards eliciting the longest response latency is 
striking enough to suggest a common deter- 
mining factor. Although the identification of 
this factor cannot be established on the basis 
of the available data, a likely possibility would 
be that specific characteristics of these par- 
ticular cards make for difficulty in deriving 
concepts from them. It is a matter of conjec- 

ture, of course, whether these characteristics 

pertain to the structural properties or the emo- 

tional evocativeness of the cards. While it may 

be seen that the degrees of difficulty in re- 

sponding to the cards are the same for differ- 

ent nosological groups, comparison with nor- 

mative data suggests that psychiatric patients 

experience more difficulty than do normals. 


Summary 


The Rorschach literature contains consid- 
onsistency among statements con- 
dence and determinants of 
Rorschach card rejection within the various 
nosological groups. While empirical studies 
have elucidated the actual incidence of rejec- 
tion, there has been no investigation of pos- 
sible personality variables underlying it. This 
study sought to explore the question using 
measures of personality variables derived from 
the MMPI and the variable of psychiatric 
diagnosis in a group of 109 hospital patients 


erable inc 
cerning the inci 


Table 3 


f the Orders of the Five Most 


Frequently Rejected Cards Derived from Empirical Studies 


Comparison 0 


Order from highest to lowest 


i ist 2nd 3rd 4th 5th 
Study Subjects 
sdivties vi i X W I 
Tamkin og neiaie an il IX X WOW V 
Sisson (9) on mentor á x VW xX V vw 
Sisson (9) 190 normals oer a x 
Mensh (4) 174 neurotics and psychotics D VI X IV Vv 
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containing subsamples of 37 neurotics and 59 
psychotics who were predominantly schizo- 
phrenic. No relationships were found between 
Rorschach card rejection and the variables of 
defensiveness, psychasthenia, depression, pa- 
thology, and diagnosis. The five most fre- 
quently rejected cards were shown to be in 
close agreement with the findings of other 
empirical studies. They were found to overlap 
to a large extent the cards evoking the longest 
response latencies, a phenomenon presumably 
a function of the relative difficulties of the 
cards in permitting the derivation of concepts. 
The available data did not permit a decision 
about whether the difficulty was derived from 
the structural properties or the emotional 
evocativeness of the cards. It was shown, how- 
ever, that the degrees of diffculty in respond- 
ing to the cards are the same for different 
nosological groups, and comparison with nor- 
mative data suggested that psychiatric pa- 
tients experience more difficulty than do 
normals. 
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í The validity of a test or of a personality in- 
= ventory is frequently defined as the extent to 
_ which it actually measures what it purports to 
measure. However, criterion measures of va- 
lidity in which data are collected in actual be- 
havioral situations are generally not available. 
With the exception of a recent study by 
Bernadin and Jessor (2), the correlations ob- 
tained thus far are between the Edwards 
Personal Preference Schedule and self-ratings 
or ratings by peers, and other personality in- 
ventories. 
© In the study by Bernadin and Jessor, the 
construct of Dependency was defined in order 
to predict the behavior in Asch’s experimental 
‘situation from behavior on the Autonomy and 
Deference subscales of the EPPS. In the 
study, the authors employed Asch’s technique 
= of measuring group behavior as the criterion 
. for oné of the propositions in the construct, 
Dependency. They suggested that the reason 
for the failure to find a © 
Asch’s behavior and behavio 
was due to the fact that the subjects were 
ity situation. 
Sas Tn the present study, in order to relate test 
“4 behavior with the criterion, the term o 
formity behavior has been defined as the nee 
not to be different, to f 


suggestions of others, to coni rs 
The conformist has less ability to tolerate his 


own impulses, less originality, and a greater 
tendency to follow external and socially ap- 
proved values. 
According to Edwards, 
ence Schedule is a 
needs or motives, 
adults seek to satisfy in the 
University Medic 


= 


onfo 


the Personal Prefer- 
f an jndividual’s 
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A Validity Study of the Autonomy and Deference 
Subscales of the EPPS 
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their lives. The needs measured by the EPPS 
were drawn from the studies of Murray (5). 
Edwards’ description of the Autonomy and 
Deference subscales of the EPPS is as follows: 


Autonomy: To be able to come and go as desired, 
to say what one thinks about things, to be inde- 
pendent of others in making decisions, to feel free 
to do what one wants, to do things that are uncon- 
ventional, to avoid situations where one is expected 
to conform, to do things without regard to what 
others may think, to criticize those in positions of 
authority, to avoid responsibilities and obligations. 

Deference: To get suggestions from others, to find 
out what others think, to follow instructions and do 
what is expected, to praise others, to tell others that 
they have done a good job, to accept the leadership 
of others, to read about great men, to conform to 
custom and avoid the unconventional, to let others 
make decisions (4, p. 5)- 


The Autonomy subscale purportedly meas- 
ures the same personality variable, conformity 
behavior, as defined above. Furthermore, there 
is indication that the Deference subscale is 
measuring a trait which is in opposition to the 
trait measured by the Autonomy subscale. 


Procedure 


The purpose of this study was to determine 
the validity of the Autonomy and- Deference 
subscales of the EPPS by correlation with a 
criterion measure of conformity behavior. The 
method of measuring conformity behavior is 
a modification of Asch’s basic group situation 
developed for measuring conformity behavior. 


Asch’s (1) technique of measuring conformity be- 
havior requires the subjects (Ss) to report which of 
three parallel lines is equal in length to a standard 
line. One naive S is placed in a group with three 
other Ss who have been previously instructed to give 
jncorrect answers. Asch found that an individual is 
not likely to deviate from the group; he is more 
likely to go against the evidence of his own senses 
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when the difference is most difficult to perceive, when 
the group is unanimous against him, and when those 
in opposition increase in numbers. 


The present study employed Asch’s method, 
with the exception that four naive Ss were 
used, as in Crutchfield’s (3) modification. The 
present study did not employ Crutchfield’s 
electrical apparatus to record responses. 

In the present study, 50 volunteer Ss, 31 
males and 19 females, were drawn from four 
sections of an elementary psychology course. 
‘An attempt was made to control prestige ef- 
fects by selecting not more than two Ss from 
a class to participate in each group of four 
Ss. Four Ss were instructed to enter the ex- 
perimental room and take seats randomly 
among four partitioned chairs. The only per- 
son they could see was the experimenter, who 
was seated about 13 ft. in front of them at a 
small table. At each S’s desk was an instruc- 
tion sheet and three response cards numbered 
1, 2, and 3. In each of the 18 trials, the ex- 
perimenter displayed two large cards: the 
card on the left showed the standard line, and 
the card on the right showed three parallel 
comparison lines numbered consecutively 1, 
2, and 3. Then the four Ss made their judg- 
ments to the standard by raising a card num- 
bered to correspond with the selected com- 
parison line. 

The illusion of the procedure rested on 
each S’s belief that he was the fourth and final 
person to make a judgment. When the ex- 
perimenter reported the judgments of the first 
three Ss, he was creating a false group ma- 
jority. Actually, no one had reported. The 
pressure to conform to the group was artifi- 
cially produced. False majority judgments 
were reported in 9 of the 18 trials. Whether 
the experimenter reported a true or false 
majority response, it was unanimous; the first 
three Ss were reported to have given the same 
judgment. ate 

The differences to be discriminated were 
considerable; most unequal comparison lines 
were Clearly longer or shorter than the stand- 
ard. The comparison lines differed from the 
standard by varying amounts between .5 and 
1.75 inches; no attempt was made to maintain 
a constant ratio between them. On successive 
trials the equal line appeared randomly in 
different positions. 


Darrell Gisvold 


After being subjected to the group con- 
formity situation, the group of 50 students » 
was given the Edwards Personal Preference 
Schedule within a two-week period. $ 


Results ! 


A comparison of the data obtained from 
the students sampled in this study was made 
with both the results obtained by Asch in 
his measurement of group conformity and 
that of Edwards’ normative sample of the 
Personal Preference Schedule. 

A control study was made in order to de- | 
termine whether the Ss’ conformity errors 
were due to indiscriminable line lengths. In 
the control group of 10 Ss, an average of 8 
errors were made in the 9 critical trials. The 
expected frequency of error on a chance basis 
should have been 67%. The frequency of 
error found was 9%. For the sample of 50 Ss 
used in this study, it was found that there 
were 32% conformity errors. This approxi- 
mates both the results of Asch and Crutch- i 
field of about 30% conformity errors. 

An analysis of the difference between the 
subscale variances of the present sample and 
Edwards’ Normative sample was made by em- 
ploying the variance ratio, F. In all cases, the 
F ratios computed were not large enough to ~ 
reject the null hypothesis at the .05 level of 
confidence, Further analysis was made by 
testing the subscale mean difference of the 
two samples. A £ test was employed to test the 
mean differences, The only significant differ- 
ences found between the two population sam- 
ples was on the Succorance subscale and the i 
consistency scores. The former was significant 
at the -O1 level of confidence, and the latter 
Was significant at the .05 level in a directio 
toward greater consistency of the present + 
sample. 

The product-moment correlation between 
the scores on the Autonomy subscale and 
conformity scores from the group conformity 
Situation was found to be —.54, significant 
at the .02 level of confidence, Therefore, there 
is a high degree of assurance that the Au- 
tonomy subscale is measuring the need for 
Autonomy as described by Edwards. 

& e product-moment correlation between 
© Scores on the Deference subscale and con- 
ormity scores from the group conformity 


mw 
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Validity of the Autonomy and Deference Scales of the EPPS 


situation was found to be .17; this value was 
not large enough to reject the null hypothesis 
at the .05 level of confidence. The correlation 
ratio eta was computed in order to test for 
the possible existence of a curvilinear rela- 
tionship between regression lines, and no sig- 
nificant difference was found. 


Summary 


The aim of this study was to determine the 
empirical validity of the Autonomy and De- 
ference subscales of the EPPS. A group situa- 
tion developed by Asch to measure conform- 
ity behavior was used as the criterion. 

The correlation between the conformity 
scores and the scores On the Autonomy sub- 
scale was found to be —,54, significant at 
the .02 level of confidence. Therefore, the 
Autonomy subscale of the EPPS as described 
by Edwards is empirically valid with respect 
to the criterion of conformity behavior as de- 


veloped for this study- 
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The correlation between the conformity 
scores and the scores on the Deference sub- 
scale was not significant. On the basis of the 
criterion measure, conformity behavior, the 
Deference subscale does not predict an indi- 
vidual’s conformity behavior. These findings 
indicate that a person who has a need for 
Deference does not necessarily exhibit an 
equal need to conform to group situations. 
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Relationship Between Achievement Motivation 
Scores and Manifest Anxiety Scores 


Donald H. Kausler and E, Philip Trapp 


University of A rkansas 


A number of studies (e.g., 2, 4, 6, 7) have 
indicated that task performance may be a 
function of achievement motivation. In these 
studies, however, no effort was made to con- 
trol for other motivational or drive variables. 
Apparently, the assumption was taken that 
the other drive variables operate randomly in 
groups differentiated on measures of achieve- 
ment motivation. 


ment test possibly could be related to the 
anxiety drive level of subjects. Groups formed 
on the basis of achievement test scores would 
then also represent groups differentiated with 


Method 


Subjects. One hundred and three male stu- 
dents in general and abnormal psychology 
courses at the University of Arkansas served 
as Ss. Only malé Ss were used because of the 
strong possibility, as suggested by Atkinson 
(1), of a pronounced sex difference in achieve- 


ment motivation. Al] testing was conducted 
during regular class periods. 

Instruments. The complex motivation test 
developed by French (4, 5) served as the 
achievement motivation measure. The test 
Was scored for achievement motivation by the 
scoring system devised by French. Close 
agreement was found between test scores for 
two scorers working independently, 

The Taylor Manifest Anxiety Scale (8) 
served as the measure of anxiety drive level. 
The standard administration and scoring pro- 
cedure outlined by Taylor were followed. 

Procedure. 
test, disguised as a 
administered early in the semester. The Ss 


Results 
A correlation Coefficient was computed be- 


tween the scores received on the two tests, 
Since the scores on both the French test and 


tained, which js Significant at the 05 level 
of confidence (¢ = 2.05). Thus, when the en- 
tire range of scores is Considered, there is a 
small, but significant, hegative correlation be- 
tween achievement and anxiety test scores. 
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Achievement Motivation and Manifest Anxiety 


Table 1 


Achievement Motivation and Anxiety Drive Level: 
Observed and Expected Frequencies 


Achievement motivation 


Anxiety 
drive High Low 
5 5 
High 2 8 
7 7 
Low 10 4 


ee eae 


Note.— x? = 6.17 (p < 02). 


Since most studies employing achievement 
motivation and anxiety tests compare Ss only 
at the two extremes of the scoring range, an 
additional analysis of the data was performed. 
Four groups consisting of the top and bottom 
quartiles on both tests were determined (N 
= 26 in each quartile). A 2 X 2 contingency 
table was then established and tested by chi 
square. In the table, the two groups Were high 
and low achievement motivation, and the two 
classifications were high and low anxiety 
drive, The results of this analysis are given 


in Table 1. iif 
An inspection of Table 1 shows that hig 

achievement motivation scores are relate to 
low anxiety scores an! that low achievement 
motivation scores are related to high anxiety 
scores, The over-all x is 6.17, which a sie: 
nificant at the .02 level of confidence. en. 

dered, the nega- 


roups are consi ] 
only extreme group variables 


i onship between the two $ 
tivere on nounced. This lends addi- 


becomes more PI ced. 
tional support for the rejection of the null hy- 
pothesis of no relationship between the two 
sets of scores. 


Discussion 


notably from the Jowa group (3, 
d that performance level 
on various tasks may be affected by anxiety 
drive level. Consequently, the relationship be- 
tween achievement motivation and anxiety 
drive should definitely be taken into account 
in studies attempting to relate achievement 
motivation to performance. Otherwise, the ef- 
rent levels of achievement motiva- 


fect of diffe x r 
tion on performance might be contaminated 


Research, 
9), has demonstrate! 
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by corresponding systematic differences in 
anxiety drive level. In other words, an at- 
tempt should be made to partial out differ- 
ences in anxiety drive level when Ss are differ- 
entiated on the basis of achievement test 
scores. 

Two alternative interpretations are offered 
for the correlation between achievement and 
anxiety test scores. The first suggests that 
both tests are measures of the same general 
drive state. In this case, the correlation simply 
reflects the amount of overlap. The second 
interpretation suggests that the two tests are 
measures of two different but related drive 
components. In this case, the correlation simply 
reflects the degree of interaction. The resolu- 
tion of these opposing explanations is funda- 
mentally dependent upon further validity 
studies on both achievement motivation and 
manifest anxiety tests. Current evidence is in 
the direction of favoring the second interpreta- 
tion, but the lack of sufficient validation evi- 
dence indicates the need for further investiga- 
tion into the nature of the drive components 
measured by tests of human motivation. 


Summary 


A comparison was made between the scores 
received on the French Achievement Motiva- 
tion Test and the Taylor Manifest Anxiety 
Scale by 103 undergraduate male students. A 
rho of —.20 was obtained (p < .05). In ad- 
dition, a chi square analysis of the data was 
performed. In the resultant four-fold con- 
tingency table, the two groups consisted of the 
top and bottom quartiles on the achievement 
motivation test, and the two classifications 
consisted of the top and bottom quartiles on 
the anxiety test. The over-all x? was 6.17 
(p < 02). The results clearly reflect a sig- 
nificantly negative relationship between the 
two sets of scores, and indicate the need to 
partial out the anxiety drive component in 
studies designed to measure the effects of 
achievement motivation. The question of 
whether the Taylor scale and the French test 
are actually measuring two aspects of the 
same drive state or aspects of two interrelated 
drive states is raised. 
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Interrelationships Among Three Measures 
of Need Achievement’ 


Philip Himelstein * 


University of Arkansas 


Arthur E. Eschenbach and A. Carp“ 


Personnel Laboratory, Wright Air Development Center 


In recent years, there has been consider- 
able effort devoted to investigating the char- 
acteristics of the achievement motive (n-Ach). 
For this purpose, three tests have been pre- 
sented which are suitable for research involv- 
ing large groups: the n-Ach scale of the Ed- 
wards Personal Preference Scale (2), French’s 
Test of Insight (3, 4), and McClelland’s n- 
Ach (8). The latter two tests are projective 
tests of n-Ach, while the Personal Preference 
Schedule is an objective, forced-choice test 
which provides, among others, a scale of 
achievement. In a recent study, Bendig (1) 
reported a correlation of .11 between McClel- 
land’s projective measure of n-Ach and Ed- 
wards’ objective n-Ach scale. The obtained 
correlation, with M = 244, was not significant 
at the .05 level. The present study is an at- 
tempt to verify Bendig’s findings and, at the 
same time, investigate the relationship be- 
tween two projective tests of n-Ach, McClel- 


land’s and French’s. 
Procedure 


udy were 298 members of 


Ss in this st 
ean f the Air Force Academy, 


an entering class O 


1 This investigation was carried out under the Air 
Force Personnel and Training Research Center in 
support of Project No. 7719. Permission is granted 
for reproduction, translation, publication, and use or 
disposal in whole or in part by or for the United 


States Government. 
2With the Personnel Laboratory, WADC, when 


this study was conducted. 

8 The authors would like to express appreciation 
to Raymond E. Christal, Eli S. Flyer, John D. 
Krumboltz, and Ernest C. Tupes, for their assistance 
in planning the study and reading portions of the 


manuscript. 


Denver, Colorado. The Ss were tested in July, 
1957, within one or two days after reporting 
to the academy. The three tests were ad- 
ministered within a period of two days as 
part of a larger testing program. 


Pictures A, B, D, and E of the McClelland n-Ach 
test (8, p. 375) were used in this study. All stories 
were independently scored by two psychologists after 
practice with stories in the manual. Before scoring 
the papers obtained from the present sample, the 
two scorers compared their scores with those of the 
authors of the McClelland scoring system (8, pp. 
335-374). Correlations in the .80’s were obtained for 
the scorers when compared with the manual. This is 
similar to the level of agreement obtained by other 
users of this scoring system (6). All 298 papers were 
scored by both raters. In addition to the independ- 
ent scores obtained by the two psychologists, a 
“joint score” was obtained. This score was obtained 
as follows: Differences of three points or less in to- 
tal score were averaged; larger differences were 
settled by rescoring the stories jointly. Interscorer 
reliability before the scoring conference was .714 for 
the entire sample. 

Form I of French’s Test of Insight (4, p. 5) was 
used in this study. The scoring system for this test 
is similar in many respects to McClelland’s system. 
This test was scored after the raters had obtained 
considerable practice in scoring the McClelland n- 
Ach test. The raters independently scored two intact 
testing groups (V=77). Rater reliability for these 
cases was .70. Each scorer then scored approximately 
half of the remaining cases. The “joint score” in this 
instance was obtained for the first 77 cases, using the 
same procedure as described above for the McClel- 
land joint score. 


Results and Discussion 


It can be seen from Table 1 that no sig- 
nificant relationship was obtained among the 
three measures of n-Ach. The results bear out 
Bendig’s finding of a lack of relationship be- 
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Table 1 
lations of the Measures of 
ieee oO Achievement 
Tests 
French- French- McClelland- 
Raters McClelland Edwards Edwards 
A —.024 -105 —.018 
i (172) (172) (298) 
B 047 -082 .010 
(203) (207) (298) 
i —.067 019 003 
i (77) (77) (298) 


Note.—Numbers in parentheses refer to size of sample. 


tween an objective and projective measure of 
n-Ach. In addition, the Present study failed 
to find a significant relationship between two 
projective measures of n-Ach. In view of the 
fairly high interscorer reliabilities for tests of 
this nature, one would expect, if they are 
actually measuring a “general need for 
achievement,” that a significant relationship 
would exist between them. 

There are no published reports of the test- 


lack validity. 

Tt should be pointed out that, although this 
study indicates that these measures are unre- 
lated, their “validity” was not investigated, 
It is possible that the three scores are meas- 
ures of three independent but real traits 


Philip Himelstein, Arthur E. Eschenbach, and A. Carp 


whose only similarity is the names assigned 
them. This would indicate that some redefin- 
ing is necessary. At any rate, it should be 
pointed out, as others (5) have done, that it 
is dangerous to use interchangeably traits 
that are similarly defined but measured by 
different instruments. 


Summary 


The problem under investigation concerned 
relationships existing between three measures 
of achievement motivation: the n-Ach scale of 
the Edwards Personal Preference Schedule, 
McClelland’s test, and French’s Test of In- 
sight. Fairly high interscorer reliabilities were 
obtained for the two projective tests of 
achievement, However, no significant relation- 
ships were found for the three measures pur- 
Porting to measure achievement motivation. 
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Differentiation of Diagnostic Groups by 
Individual MMPI Scales’ 


Albert Rosen 


University of Maryland 


A multiscaled instrument such as the MMPI 
is generally interpreted in terms of ‘configura- 
tions of scale patterns and elevations. Infor- 
mation concerning the concurrent validity of 
individual scales can nevertheless be of con- 
siderable value. Besides indicating the degree 
of differentiation possible between diagnostic 
groups by means of individual scales, such in- 
formation can also contribute to the enrich- 
ment of configural kinds of interpretations 1 
the psychiatric setting. Of even broader sig- 
nificance is the fact that data on individual 
scale discrimination can add to our total com- 
prehension of the meanings inherent in a spe- 
cific scale and therefore are apt to suggest 
other significant relationships and inferences. 

Although the present study was part of a 


ject and not planned as a replica- 
TRE of special interest be- 


tion, the findings are i 
cause of another report that virtually no 
i iati iatric groups 1S 
differentiation between psychiatric 8 i 
possible using individual MMPI scales. Rubin 
(6, 7) has report that the av Gapo 

i . . . ic 
igni differentiate between jagnosti 
pa a tric hospital. He se- 


in a psychia 
fected. i random 93 MMPI records of pa- 


tients, the total group consisting of 8 chronic 
alcoholics without psychosis, 24 psychopaths, 
33 schizophrenics, 28 psychoneurotics. 
Using the analysis of variance method, he 
found that only one clinical scale, Sc, differ- 
entiated in some manner between the four 
diagnostic groups. This paper presents addi- 
tional data on the discriminating power of the 


1 This research was aone 1n the Psychiatry Service 
lis VA Hospital. The investigator is 


of the Minneapo l. } 
jndebted to Leonard I. Schneider for suggestions 
leading to improved organization and clarity of the 


report. 


individual MMPI scales, as well as some pos- 
sible explanations of Rubin’s negative results. 


Procedure 


Five groups from the psychiatry service of 
the Minneapolis VA Hospital were chosen 
which were composed of 307 patients diag- 
nosed according to the Veterans Administra- 
tion psychiatric nomenclature as follows: (a) 
anxiety reaction (anxiety state)—83 cases; 
(b) conversion reaction (conversion hysteria) 
—49 cases; (c) depressive reaction (neurotic 
depression) —36 cases; (d) somatization re- 
action (psychophysiological reaction, psycho- 
somatic reaction, organ neurosis) —39 cases; 
and (e) schizophrenic reaction, paranoid type 
—100 cases. 

The few published studies providing objec- 
tive data for the evaluation of diagnostic reli- 
ability have emphasized that there is a high 
degree of inconsistency in psychiatric diag- 
nosis (2, 3, 5). If diagnostic unreliability does 
prevail, psychological research based upon a 
diagnostic criterion is apt to be of limited 
value, for patients classified within any one 
diagnostic group will be quite heterogeneous, 
and there will be considerable overlapping be- 
tween groups. 

Because of the importance to the present 
study of obtaining homogeneous diagnostic 
groups, only so-called “pure” cases were se- 
lected for each sample. Thus, a case was ex- 
cluded if there was evidence that the patient 
had been given (a) two different diagnoses 
upon successive admissions, or (b) a diag- 
nosis containing a statement of overlapping 
trends, as for example, “anxiety reaction with 
paranoid and schizoid trends.” There was 
however, one exception to this rule. Inasmuch 
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Fig. 1. Mean T scores for three diagnostic groups on each MMPI scale. 


as a large number of anxiety reaction cases 
suffer from depression, it was not feasible to 
exclude cases of “anxiety reaction with de- 
pression.” 

The procedure in selecting patients for the 
five diagnostic groups was as follows: 


1. From a file listing the final diagnoses of all 
patients who had been tested, the names .were se- 
lected of “pure” cases who had been diagnosed in 
one of the five categories listed above.? 

2. For the purpose of increasing the homogeneity 
of each diagnostic group, there were included in the 
study only male, white veterans who had been tested 
within 15 days after admission and who had not re- 
ceived insulin or electroshock therapy prior to the 
administration of the MMPI. The median number of 
days between admission and MMPI administration 
for each of the five final samples was between 3 
and 4, p 

3. The MMPI records of the patients selected were 
obtained from their test folders, and a few addi- 
tional cases were removed on the basis of extremely 
high L, F, K, and ? scores. In the final samples, the 
median number of ? items for each of the five diag- 
nostic groups was 2-4, Q: was 6-14, and only 15 
records contained more than 30 ? items. 


Results 


The following procedure was used to test 
the significance of the differences in means 
of each MMPI scale for the five diagnostic 
groups: 

2 An exception was the group of patients diagnosed 
paranoid schizophrenia. Because of their abundance, 


100 cases were selected from those most recently dis- 
charged. 


1. The Bartlett test (4, p. 97) was applied and 
heterogencity of variances (p<.05) of the five 
groups was found for six of the scales: F, K, Pd + 
AK, Pa, Sc+1K, and Si. 

2. For each of these six scales, critical ratios were 


calculated for the 10 possible differences between 
means, 


3. For each of the other seven scales with homo- 


geneous variances, an analysis of variance test was 
made. 


The mean scores of the diagnostic groups 
for each MMPI scale are shown in Fig. 1 and 
listed in Table 1. These T scores are rounded 
numbers because all calculations were made 
with raw score means and variances. The F 
ratio is also recorded in Table 1 for the seven 
scales for which this statistic was computed. 
Since the curves for the Depression and Anx- 
iety groups and for the Somatization and Con- 
version groups are almost identical, the me- 
dian profiles for only three groups are shown 
in Fig. 1 in order to avoid a confusion of 
lines. On seven of the scales there is an or- 
derly hierarchy of mean scores, with the 
Paranoid Schizophrenia group being highest, 
and the Depression, Anxiety, Somatization, 
and Conversion groups following in order. 
These seven scales are F, Pd + 4K , MÍ, Pa, 
Pt + 1K, Sc + 1K, and Si. On the D scale, 
this order for the five groups is the same €x- 
cept for a reversal of the Depression and 
Paranoid Schizophrenia groups. In the profiles 
of the Somatization and Conversion groups, 
the Hs +.5K, D, and Hy scores are most 
elevated with D slightly lower than the other 


» 


EE 


two. This is the so-called «Vy profile,’ 
quently noted for individual cases diagnosed 
as conversion or somatization reaction. 
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> fre- scale scores for the five diagnostic groups, 61 
are significant at or beyond the .05 level, as 
listed in Table 2. Eleven such differences 
would be expected by chance if the statisti- 


Among the 130 possible differences in mean 


Table 1 


Mean T Scores of Five Diagnostic Groups on Each MMPI Scale 


Diagnostic groups 


Paranoid 
schizo- Somatiza- 
Gre 00 i aoe Anxiety tion Conversion F 
N= (N = 36) (N = 83) (N =39) (N = 49) Ratio 
L 50 47 
F 70 58 38 34 34 a 
K 51 50 51 56 54 
Hs +- .5K 71 71 73 79 76 
D 81 88 81 71 70 aa 
Hy 70 71 72 72 73 cee 
Pa + 4K 74 64 63 59 59 = 
cf T 62 ‘0 S 33 ml 
PL+ 1K St 77 76 66 62 16.16** 
Se 4 IK 87 67 67 62 60 À 
63 54 55 56 58 +e 
61 53 51 o% 


* Significant at .05 level. 
001 level. 


** Significant at -! 
Table 2 
Different in Mean Scores on Each MMPI Scale 


stic Groups Significantly 


Diagno: 


ences (P 9°) Paranoid Schizophrenia g 


Diagnostic groups 


Paranoid 

schizo- 

phrenia Depression Anxiety Somatization B ii 
(W = 36) a =83) (= 39) (y= 49). 


MMPI 
Scale ( = 100) 
higher than score of— 


ore of above groups 
AD 


Mean sc 
AD 
A DASC 
P PAD 
et 3 
Bit sc PASC sc 
Hy 
pa + 4K DASC G c 
Mf ASC SẸ G 
pA DASC S- € 
Pi+1K ASC Sse sc 
Se + 1K DASC c 
Ma + ŽE ADCS 
Si sc sE sc 


Note.—Each, capital letter in the body of the table denotes a diagnostic i 
Depression; Aane Se M omatizationi C—Conversion. The table may be read ¢ Flos E There nold Schizophrenia; D 
05) between the ve diagnos' oups on the various scales. For example, on the L E ihe 61 significant differ- 

the Anxiety and Depression groups and the a au ee Beant 


differences 
has a higher mea! 
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cal tests were independent (8). Of these 61 
differences, 17 are significant at the .05 level, 
8 at the .01 level, 5 at the .001 level, and 31 
at or beyond the .0001 level. The Anxiety and 
Depression groups are significantly different 
from each other only on the D scale, and the 
Somatization and Conversion groups are simi- 
lar on every scale. If the Anxiety and Depres- 
sion groups are combined, and the Somatiza- 
tion and Conversion groups are also treated 
as one group, each of these two groups is ef- 
fectively differentiated from the other and 
from the Paranoid Schizophrenia group. Cross- 
validation of this finding is necessary, how- 
ever, for the combining of groups was done 
after inspection of the data. Neither the Hs 
+ .5K nor the Hy scale differentiates the 
Somatization or Conversion groups from the 
other three groups. 


Discussion 


The positive findings of the present study 
contrast sharply with the almost complete 
lack of MMPI differentiation between Rubin’s 
diagnostic groups. Three possible explana- 
tions of the divergent results will be dis- 
cussed as follows: (a) High ? scores in 
Rubin’s records; (b) criterion contamination 
in the present study; and (c) criterion un- 
reliability in Rubin’s groups. 

High ? scores. Rubin (7) reported that 9 
of the 93 MMPI records in his study con- 
tained more than 100 unanswered items. The 
writer has seen the complete distribution of 
? T scores ° for the 93 records, and found that 
34, or 37% of the records, contain more than 
30 unanswered items. Of these 34, 16 have 
31-50 such items, 7 have 51-90, 5 have 91_ 
110, and 6 have more than 130 ? items. 

Rubin also indicated that 21% of his 
records of psychotics had more than 100 un- 
answered items, whereas only 7% of the neu- 
rotics’ records and none of the records of psy- 
chopaths had more than 100 3 items. More- 
over, the mean ? scores of Rubin’s psychotic, 

neurotic, and psychopathic groups are also in 
this descending order. The effect of a large 
number of unanswered items in any record is 
to sharply reduce the scores on the MMPI 


8 The distribution of ? scores was obtained through 
the courtesy of Paul E. Meehl. 
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scales. If the number of unanswered items is 
highest for a group of psychotic patients, 
next highest for neurotics and still lower for 
psychopaths, the scores of the MMPI scales 
of the psychotic and neurotic groups might be 
reduced to the extent that these two groups 
could not be distinguished from each other 
or from the psychopathic group. This phe- 
nomenon has apparently occurred in Rubin's 
study, and could account in large part for 
his negative results.*: 5 

Contamination of the criterion. The psy- 
chiatrists who made the final diagnoses of 
the cases included in this study had access 
to the psychologists’ interpretations of the 
MMPI records. It should be noted, however, 
that the MMPI interpretations were made in 
terms of the scale Configurations, and there- 
fore should have had minimal effect on the 
differentiating Power of any individual scale. 
A further mitigating feature is that the psy- 
chiatrists claimed they were influenced by the 
MMPI interpretations primarily in the diag- 
hosis of “borderline” cases. Nevertheless, the 
criterion Contamination, although unavoid- 
able, presents a serious limitation on the 
evaluation of the results because its effects 
cannot be precisely measured. Replication of 
this investigation in a clinical setting where 
MMPI results do not contribute to final diag- 
nosis would be desirable. 

Diagnostic unreliability. In studies in which 
a diagnostic criterion is used, divergent re- 
sults may often partly be attributed to the 
nonhomogeneity of diagnostic categories and 
to the resultant inconsistency of diagnoses. 
Any investigation based on highly unreliable 
Criteria is doomed to negative or inconclusive 
Outcomes. Rubin did not mention any attempt 
at diagnostic purification, and, in fact, the 
Category of alcoholism, which Aaronson and 
Welsh (1) have indicated, generally overlaps 


Le Sees and Welsh (1) have also discussed the 

3 : N ,, 

stidy. raed 3 extremely high ? scores in Rubin’s 
f hig o fhe misleading and indeterminable 


5 As 
effect of high ? scores. $ 5 E 
Minneapolis V. ae it has been the practice ai 
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considerably with the psychopathic and neu- 
rotic categories. 

The null hypotheses which were tested in 
Rubin’s study and in the present investiga- 
tion can now be restated in order to evaluate 
further the divergent results and to empha- 
size the kinds of decisions which might be 
made in future research into the differenti- 
ability of diagnostic groups by means of the 
individual MMPI scales. 

Rubin’s null hypothesis may be formulated 
as follows: Individual MMPI scales do not 
differentiate the broad categories of neurosis, 
psychosis, psychopathic personality, and al- 
coholism without psychosis if the patients are 
selected without regard to diagnostic purity 
and to the number of unanswered items in 
their MMPI records. It is a contribution to 
our knowledge of the effectiveness of the 
MMPI to learn that Rubin’s null hypothesis 
cannot be rejected when the MMPI is used 
in the manner which he employed. It re- 
mained to be determined, however, how effec- 
tive the MMPI is in differentiating diagnostic 
zroups when the size of the ? scores is con- 
trolled and a reasonable degree of homoge- 
neity is present in the criterion groups. 

The null hypothesis tested in the present 
investigation may be stated as follows: Indi- 
vidual MMPI scales do not differentiate be- 
tween groups of patients diagnosed in the 
categories of paranoid schizophrenia, neurotic 
depressive reaction, anxiety reaction, conver- 
sion reaction, and somatization reaction if 
(a) “pure” diagnostic groups of patients are 
selected (with the exception that cases of 
anxiety reaction with depression are in- 
cluded), (2) the number of ? items in the 
MMPI records is kept to a minimum, and 
(c) an unmeasurable amount of criterion con- 
tamination occurs. It was found that the null 
hypothesis could substantially be rejected ex- 
cept for the comparison of the Depression 
and Anxiety groups, exclusive of the D scale, 
and likewise in the comparison of the Con- 
version and Somatization groups. If, however, 
the Depression and Anxiety groups are treated 
as one class, and the Conversion and Somati- 
zation groups are combined, each of these two 
groups is effectively differentiated from the 


other and from the Paranoid Schizophrenia 


group. 


N 


Summary 


A major purpose of this paper was to re- 
port an investigation into the effectiveness of 
the individual MMPI scales in diagnostic 
group differentiation. A correlated aim was 
to test the generality of the findings of Rubin 
who reported that only one MMPI scale dif- 
ferentiated in any manner between four diag- 
nostic groups: psychotics, neurotics, psycho- 
paths, and alcoholics without psychosis. 

A total of 307 patients was selected who 
had been diagnosed in five categories: para- 
noid schizophrenia, neurotic depressive reac- 
tion, anxiety reaction, somatization reaction, 
and conversion hysteria. An attempt was 
made to select for each diagnostic category 
only “pure” cases without overlapping diag- 
nostic trends whose MMPI records contained 
a minimum of unanswered items. Of 130 pos- 
sible differences in means for 13 cases, 61 
were significant at or beyond the .05 level. 
The positive findings of the present study, 
therefore, contrasted sharply with the results 
obtained by Rubin. Three possible explana- 
tions of the divergent results discussed were: 
large numbers of unanswered MMPI items 
and diagnostic overlapping in Rubin’s groups 
and criterion contamination in the present 
study. 
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Changes in Responses to a Set of 
Personality-Inventory Items as 4 
Function of Age’ 


Richard H. Walters 


University of Toronto 


and Misha S. Zaks 


Northwestern University Medical School 


Strong’s first interest-maturity scale was de- 
veloped by contrasting the responses of 55- 
year-old men and 15-year-old boys to items 
of his Vocational Interest Blank. Mean scores 
on this scale showed a rapid increase from age 
15 to about age 21, then a more gradual rise 
to about age 50. It seems reasonable to sup- 
pose that responses to certain personality- 
inventory items might change as a function of 
age and that a scale composed of such items 
might be sensitive to some aspects of the 
maturational process. The present research 


constitutes an inquiry into the feasibility of 
such a scale. 


A 160-item inventory was administered to 

32 15-year-old boys and 37 15-year-old girls. 
The boys’ responses to each item were com- 
pared with those of 50 adult males, the girls 
with those of 50 adult females. Twenty-one 
items with which adolescents agreed signifi- 
cantly more often than the same-sex adults 
were thus identifed. 

These items were now treated as a scale, 
and inventories of Ss in various age groups 
were scored for the number of agreements 
with the items. An analysis of variance showed 
a highly significant increase in mean scores 
for high-school boys over the age groups of 
16, 17, and 18-19 years (p x .001). Mean 
scores of girls also significantly increased over 
the available age groups of 15, 16, and 17 

is study may be ob- 

KA opsat kot CE 
sein nt of Psychology, University of Toronto, To- 
ane Ontario, or for a fee from the American 
A ae entation Institute. Order Document No. 5697, 
omnis $1.25 for microfilm or $1.25 for photo- 


copies. . 


years (p < 02). A graphical representation 
of results showed a relatively rapid increase 
in mean scores during adolescence, and a 
slower increase during early adult years. Data 
from male industrial employees suggest that 
Scores may continue to increase slowly up to 
50 or 60 years, 

Since the total number of agreements to all 
160 items did not significantly increase for 
male Ss from 15 to 18-19 years, changes in 
scale scores cannot simply reflect a greater 
readiness of adolescents to agree with items 
regardless of their content. The mean scores 
of 16 high-IQ and 16 low-IQ Ss were not 
significantly different. Since these Ss were 
matched approximately for age, the scale ap- 
parently reflects something more than an in- 
crease in mental age. P 

The meaning of the increase in scores with 
age is nevertheless quite unclear at the presa 
ent time. The changes may have no signifi- 
cance whatsoever beyond the fact that they 
occur. Even so, they constitute a warning ‘to 
Psychologists who administer personality in- 
ventories to adolescent Ss and then interpret 
them with the aid of adult norms. The ques- 
tion should not, however, be left thus oe 
decided. High-scoring and low-scoring Ss 2a 
the same age range might be compared in 
their responses to other types of stimuli. If 
significant Correlates of scale scores were thus 
identified, it might be possible to construct a 
scale which reflected important aspects of the 
maturational Process, 

Brief Report. 
Received June 6, 1958. 
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“Ideal Self” Instructions, MMPI Profile Changes, and 
the Prediction of Clinical Improvement’ 


Gerald M. 


Rapaport * 


Fort Dix, New Jersey 


A number of recent studies on the Minne- 
sota Multiphasic Personality Inventory have 
dealt with the problem of response sets in- 
herent in that test (1, 6, 7) and with the ef- 
fects of experimentally induced instructional 
sets on test performance (4, 8, 10, it). These 
studies were undertaken to specify those vari- 
ables which may influence patterns of re- 
sponse apart from the content of the test 
items and to determine whether these sys- 
tematic effects can be utilized to improve the 
diagnostic and prognostic merit of the instru- 
ment. 


The present study investigated the effects 


of an “ideal self” instructional set on test 
performance. The following ee Ee 
put forth: (a) the introduction of an “idea 
self” set produces changes 1n the MMPI pae 
ternings of psychiatric patients relative to the 
values obtained under the customary instruc- 


tional procedures; (b) the changes in MMPI 


patterns are in the direction of fewer elevated 


; the more deviant the original 
ema gt more marked the change; 
(d) the interindividual variability is signifi- 
cantly less on the “ideal self” pattern than on 

a elf” pattern. 
j a by Gan & Olinger (10) closely 
paralleled the present design. Employing the 
novel instructional set “typical well-adjusted 
adult on the outside,” the authors found that 
the ability to improve MMPI performance on 
the second testing was a favorable prognostic 


1 The author wishes to express his gratitude to the 
following individuals for their aid in data collection, 
statistical analyses, and for their suggestions: Robert 
J. Marshall, Arthur Burdett, Bernard Doran, Charles 
Henin, Alfred Herbert, David Perry, and John Ryan. 

2 Currently at Illinois Institute of Technology. 


index of early hospital discharge. In the pres- 
ent study, an attempt was made to determine 
whether Grayson & Olinger’s prognostic find- 
ing held true under the present instructional 
procedures. 


Tests of the Hypotheses 
Procedure 


The sample used in the present study con- 
sisted of 48 military personnel, all of whom 
were psychiatric patients. The subjects (Ss) 
were drawn over a six-month period from the 
psychiatric facilities of an Army basic train- 
ing center.’ Thirty-three Ss were seen as out- 
patient referrals, while the remaining 15 were 
psychiatric inpatients. Diagnostically, the 
sample consisted of 12 cases of schizophrenia, 
11 individuals diagnosed NND (no neuro- 
psychiatric disease), 20 character and be- 
havior problems, two psychotic depressions, 
and three cases of epilepsy. The MMPI 
was administered to each S twice, first under 
the customary “real self” instructional set 
and, immediately thereafter, under the “ideal 
self” instructions. The patients invariably ac- 
cepted the second MMPI as part of the 
routine clinical psychological workup. 


Results and Discussion 


Table 1 shows the mean for “real self” and 
“ideal self” administrations of the test. The 
group’s “real self” pattern reflected a good 
deal of psychiatric distress, while the “ideal 
self” pattern manifested an absence of clini- 
cal pathology. The hypothesis which pre- 
dicted that the new instructional set would 


3 This reflects an incidence rate of .004 per thou- 
sand post population per annum. 
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Table 1 


Means, Standard Deviation, and Tests of Significance of “Real Self” and “Ideal Self” Differences 
Means, , 


D SD SD 
Mean Mean SE ps í 
Scale xn Ideal Change Diff. t Real Tdeal Diff. F 
5 7 53 8.86** 2.66 2.84 18 1.07 
z E 373 385 Jo 5.50% 555 4.67 ‘88 110 
j ens 19.56 6.48 78 8.30%* 423 4.70 47 L 
7 56 14.31 6.25 1.27 4.13** 8.03 4.36 3.67 1.84 
a 40.41 18.83 11.58 1.54 7.52** 9.52 4.30 5.13 217 
p 28.21 20.68 7.42 1.13 6.47% 764 542 2.22 1.41 
a 27.37 23.25 4.12 85 44g 527 451 76 1.17 
i 26.43 24.54 1.89 76 2.48* 6.50 4.62 1.88 1.41 
n 15.00 9.87 5.12 T5 683** 536 356 180 EN 
EA 37.35 25.71 11.64 1.59 73ga 10.32 5.87 4.45 1.76" 
Se 38.87 2802 1085189 57g dye 698 5.98 186 
Me 23.02 23.04 02 83 02 519 438 81 1.18 
* Significant beyond .05 level. 
Noe te bevond a Ea in MMPI raw scores, 
statistically significant changes in the self” 
produce y 


over-all MMPI pattern was confirmed as eyi- 
denced by 10 #’s significant at the .01 level of 
confidence and one ¢ significant at the .05 
level. The second hypothesis, which Proposed 
that the change would be in the direction of 
greater freedom from mental distress was like- 
wise confirmed, as evidenced by the statisti- 
cally significant downward changes of the F, 
Hs, D, Hy, Pd, Pa, Pt, and Sc scales. 

The third hypothesis was tested by corre- 
lating each individual’s “real self” score on 
each scale with the discrepancy scores (real 
self minus ideal self.) The Pearson rs are 
shown in Table 2. Significant relationships, 
established for each of the nine clinical scales, 
indicate that the more pathological the “real 


Table 2 
Correlations Between Real Self and Extent of Change 


Scale Correlation 


Hs 

D 

Hy 

Pd 

Mf 

Pa 

Pt > 
Se 
Ma 


* Significant beyond .01 level of confidence. 


Score, the greater the discrepancy be- 
tween “real self” and “ideal self.” 

The final hypothesis was tested by com- 
Paring for each scale the standard deviation 
of the “real self” distribution with the stand- 
ard deviation of the “ideal self” patterns. 
Ten of the twelve MMPI scales shifted in the 
predicted direction, four of the variability 
changes (Hs, D, Pt, Sc) attaining statistical 
significance as measured by the F test (5, pp. 
163-165). The Probability of obtaining the 
Present distribution of variability changes by 
chance is less than .05 as tested by chi square. 
Therefore, it may be concluded that patients 
taking the MMPI show a higher degree of 
correspondence in specifying what they regard 
as “ideal” behavior than in assessing their 
present state of psychological adjustment. 

In view of the close Correspondence between 
the methodologies of the Grayson-Olinger 
study (10) and the present investigation, a 
comparison of the two sets of findings was 
undertaken. The mean “real self” and novel 
instructional set profiles for the two samples 
are presented in Fig. 1. An inspection of the 
plotted means shows that on the “real self” 
administration, the present sample manifested 
fewer psychopathic trends but more neurotic 
and psychotic features than the Grayson- 
Olinger sample, while on the novel instruc- 
tional sets the two Profiles were highly similar 
in shape. It appears that the new instructional 
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T Score L F K Hs D Hy Pd Mf Pa Pt Sc Mo 


— MHCS “Reel Selt” 
—- Groyson—Oinger “Rec! Set” 
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Fig. 1. Comparison of mean proñles of Grayson- 
Olinger sample with means of MHCS 4 sample. 


sets employed in the two studies have exerted 
virtually the identical effect upon the over-all 
distributions of the MMPI scales. 


Test of the Relationship Between MMPI 
Improvement and Clinical Prognosis 


Procedure 

Using an inpatient psychiatric sample, 
Grayson and Olinger found that MMPI im- 
Provability was related to early discharge 
from the hospital. To determine whether 
Grayson and Olinger’s finding could be repli- 
cated in the present data, follow-up data were 
obtained for Ss receiving diagnoses other than 
NND. The obtainable information, available 
for 32 of 37 Ss receiving psychiatric diag- 
noses, consisted of the patient’s military status 
at the time of follow-up. For the purpose of 
the present evaluation, the Ss were divided 
into two groups: those receiving premature 
discharges either for psychiatric disease or 
characterological inaptitude or unsuitability; 
and those successfully pursuing their military 
tours of duty. Based upon the Grayson-Olinger 
findings, the following predictions were of- 
fered: (a) On each MMPI scale the dis- 
crepancy scores between “real self” and “ideal 
self” is greater for the “in service” (good 
prognosis) group than for the “premature dis- 
charge” (poor prognosis) group. (b) The 
total discrepancy score differentiates between 
the “in service” and “premature” groups. 


4 Mental Hygiene Consultation Service, Fort Dix. 


Results and Discussion 


The first hypothesis was tested by / tests 
comparing the means of the discrepancy 
scores for each scale. While none of the #’s 
attained statistical significance, an interesting 
trend in line with the prediction was mani- 
fested. The means of the discrepancy scores 
for the “in service” group were of greater 
value than the corresponding means for the 
“premature discharge” group on eight of the 
nine clinical scales. The probability of ob- 
taining the present distribution of discrepancy 
scores on the basis of chance is .048, which 
warrants a rejection of the null hypothesis at 
the .05 level of confidence. 

The second hypothesis was tested by com- 
paring the total reduction in T scores for Ss 
in the good prognosis group, with the reduc- 
tion in T scores for Ss in the poor prognosis 
group. The results of this test, which directly 
paralleled the one undertaken by Grayson and 
Olinger, are shown in Table 3. In the Gray- 
son-Olinger study, the “good prognosis” group 
showed a significantly greater percentage of 
individuals meeting each of the three criterion 
scores than did the “poor prognosis” group. 
For the present sample, differences in the 
predicted direction occurred on two of the 
three criterion scores. However, the differ- 
ences did not attain statistical significance as 
measured by chi square, which indicates that 
in the military sample, the ability to improve 


MMPI performance is not related to environ- 
mental prognosis. 


Table 3 


Comparison of the Percentage of Individuals Meeti 
p of tl a a eet 
Three Criterion Scores of MMPI Improvement a 


Reduction in MMPI 
total T score 


90 or 
more 


65 or 
more 


45 or 
more 


47% 6S% 74 


Military 


Good prognosis group 57% 


Poor prognosis group 51% 81% 87% 


371% 69% 
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In comparing the two samples, it can be 
seen that the present sample as a whole mani- 
fested a higher percentage of MMPI improve- 
ment at each successive criterion score. Of 
special significance is the fact that the “poor 
prognosis” group in the present sample showed 
approximately as high a percentage of indi- 
viduals meeting the criterion scores as the 
“good prognosis” group of the Grayson-Ol- 
inger sample. Whether or not the intergroup 
differences in percentages of individuals meet- 
ing improvability criteria are of statistical 
significance cannot be ascertained, as the 
breakdown of the number of cases in Grayson- 
Olinger’s group was not indicated. However, 
another measure of intersample differences in 
improvability was obtainable. In the Grayson- 
Olinger sample, 5 of 45 cases (11%) mani- 
fested completely normal patterns on their 
second MMPI in that all nine clinical scores 
were below the critical range. On the other 
hand, 15 of the 37 patients receiving psychi- 
atric diagnoses in the present sample (42%) 
produced completely improved “ideal self” 
records. A chi square test which compared the 
two samples with respect to the percentage of 
complete improvement gave a value of 10.30, 
which warrants a rejection of the null hypoth- 
esis at the .02 level of confidence. This sta- 
tistically significant finding, along with the 
between group differences shown in Table 3, 
indicates that the military sample manifested 
significantly greater MMPI improvement than 
the Grayson-Olinger sample. Two explana- 
tions of this difference suggested themselves: 
(a) the novel instructional sets employed in 
the two studies produced essentially different 
response sets among the Ss; (b) populational 
differences accounted for the diverse findings. 


To determine whether the instructional sets were 
different, the MMPI was administered according to 
the Grayson-Olinger methodology to 12 Psychiatri- 
cally diagnosed military patients. Of these Ss, nine 
improved their patterns, and seven manifested com- 
plete improvement. Five of the cight inpatients 
among this group manifested complete improvement. 
The high percentage of complete improvement Dt 
responds to the data obtained under the “ideal self 
instructional set. It therefore appears that popula- 
tional variables, rather than the differential effects of 
the instructions, determined | the intersample differ- 
ence in MMPI improvability. The following are 
among the variables characterizing the military sam- 
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ple. For the most part, the sample consisted of young 
men in the 20—30 age range, many of whose prob- 
lems were acute and situational in nature. Moreover, 
as a number of writers have stated (2, 3, 9), the 
motivational component in a number of military psy- 
chiatric cases differs from that found among civilian 
patients as a result of more immediate “secondary 
gain” from the illness. Secondary gain is particularly 
great during times of stress such as combat or—to a 
somewhat lesser degree—basic training. It is quite 
likely that one or more of these variables could ac- 
count for the fact that MMPI improvability, though 
high for this sample, does not relate to environ- 
mental prognosis. One possible explanation would be 
the fact that since the motivational level of psy- 
chiatric Ss in this population is at times directed less 
towards the attainment of the “ideal self” state of 
asymptomatic behavior than towards maintenance of 
“real self” symptomatology, a number of these indi- 
viduals may not actually be striving—at that time— 
towards attainment of the ideal. In short, the ability 
to regard a symptom-free psychological state as 
Synonymous with one’s ideal may only be a prog- 
nostically favorable attribute if there is not the 


complicating factor of immediate secondary gain 
from illness, 


Whatever the explanation of the failure of 
the present sample to reproduce the Grayson- 
Olinger findings, it is suggested that the 
Grayson-Olinger prognostic finding may be of 
somewhat restricted generality. Further work 
on this question is needed in order to clearly 


delineate the predictive utility of this prog- 
nostic tool. 


Summary and Conclusions 


The present study investigated the influ- 
ence of an “ideal self” instructional set on 
MMPI performance. Four hypotheses were 
tested: (a) The introduction of an “ideal 
self” set produces changes in the MMPI pat- 
ternings of patients referred for psychiatric 
consultation; (b) these changes are in the di- 
rection of fewer scores in the “critical” or 
“unhealthy” range; (c) the more deviant the 
original MMPI record, the more marked the 
changes; (d) the interindividual variability is 
significantly less on the “ideal self” pattern 
than on the “real self” pattern. 

The MMPI was administered twice to a 
group of 48 military psychiatric patients. The 
first administration of the test was under the 
usual instructional set while the second was 
under an “ideal self” set. The above four hy- 
potheses were confirmed. 


O paes 


“Ideal Self” Instructions and MMPI Changes 


In a study highly similar to the present in- 
vestigation, Grayson-Olinger, using a “typical 
well-adjusted person” instructional set, found 
that MMPI improvability was related to clini- 
cal prognosis. An attempt was made to test 
the generality of Grayson and Olinger’s prog- 
nostic finding. Follow-up data were obtained 
for the majority of military subjects six 
months to one year following their participa- 
tion in the study. It was determined that the 
ability to improve MMPI performance was 
not significantly related to prognosis, although 
the trend was in that direction. Moreover, it 
was noted that the military sample showed a 
significantly greater over-all ability to im- 
prove MMPI performance than did the Gray- 
son-Olinger sample. The possibility that the 
intersample difference in MMPI improvement 
could be attributed to instructional differences 
was ruled out. It therefore appears that popu- 
lational variables account for the between- 
group difference. While further study of the 
Grayson-Olinger prognostic finding is called 
for, it is suggested that these authors’ find- 
ing may be of restricted generality. 
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CRPM. The scores of the CRPM were slightly 
extrapolated to give a mental age range from 
four years six months to eleven years six 
months. 

Means and variances were calculated for 
the SB scores and the ¢ test used to determine 
the significance of the difference of means, 
Results were compared on the basis of age, 
sex, color, color-sex (Negro boys vs. Negro 
girls, etc.), age-color-sex (seven-year-old Ne- 
gro boys vs. seven-year-old white boys, etc.), 
and SB IQ levels (SB below 70, 70-89, etc.). 
CRPM scores were analyzed in the same 
manner. 

Each child’s difference score (SB IQ minus 
CRPM IQ) was treated as a raw score and 
the significance of the difference of the means 
of the differences determined for the above 
groupings. 


Results + 


Stanford-Binet mean differences were slight 
and can be attributed to chance for the follow- 


girls, Negro boys vs, Negro girls white boys 
vs. white girls, and a 
There was a tendency fi 
decrease as age increased. The difference of 
SB means for the seven- 

children was 2.44 IQ poin 


for this difference was 2.17, significant at the 
.05 level of confidence. However, the decrease 
in IQ with age was comparable for Negro and 
white children and for boys and girls. Early 
school retardation may account, in part, for 
these differences. The inference is that in this 
population of children from low socioeconomic 
level, intelligence as measured by the SB is 
comparable for color, sex, color-sex, and age- 
color-sex groups. Hence, the basic assumption 
is made that there are no real differences in 


1 Tables of SB and CRPM raw scores and tables 
of SB, CRPM, and difference score means, variances, 
and group totals by SB IQ levels have been de- 
posited with the American Documentation Institute. 
Order Document No. 5739, remitting $1.25 for micro- 
film or $1:25 for photocopies. 
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intelligence as measured by the SB for these 
Negro and white boys and girls. 

Significant differences of CRPM IQ means 
were found when groups were compared on 
the basis of color. Table 1 shows that the 
white children had a mean CRPM IQ which 
was 10.29 points higher than the mean of 
the Negro children. This difference was sig- 
nificant well beyond the .01 level of con- 
fidence, having a £ value of 8.23. This is in 
gross contrast to the SB IQ results where no 
significant differences were found. 

When the data were analyzed to determine 
whether this relationship held for varying SB 
IQ levels, the results were similar. There were 
significant differences between the means of 
Negro and white children for all of the SB 
IQ groupings (SB below 70, 70-89, 90-109, 
110-129, 130 and above). The white chil- 
dren’s means were higher than the Negro 
children’s means and the differences were 
Significant at the .01 level of confidence, ex- 
cept for the SB group of 110-129, This latter 
difference was significant at the .02 level of 
confidence. 

When CRPM IQ mean differences were 
Considered for age-color-sex groups (seven- 
year-old Negro boys vs. seven-year-old white 
boys, seven-year-old Negro girls vs. seven- 
year-old white girls, etc.) the ¢ values of the 
differences were all above 3.00 with the ex- 
ception of the nine-year-old Negro and white 
PA The latter difference had a ¢ value of 
-80. 


There was no significant difference between 
the CRPM means of boys and girls nor be- 
tween Negro boys and girls or white boys and 
girls. As with the SB IQs, there was a tend- 


age. The mean dj 


eight-year-olds Was significant at the .05 level 
of confidence. The mean of the nine-year-old 
group was lower than the ej 
but the differ, 


S membered that for the 
varying groups, the SB IQ means were es- 
sentially the same, Here, 


ences were significant wel] 
level of confidence, 


ak 


w. e 
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Table 1 


Means, Standard Deviations, and ?’s for SB IQs, CRPM IQs, and Difference Scores by 
Color, Age, and Sex Groupings 


SB IQ CRPM IQ Diff. scores* 
Groups N Mean SD t Mean SD t Mean SD t 
Negro 349 90.3 13.2 0.27 80.5 16.3  8.23** 98 148 9.26%" 
White 440 90.6 15.1 90.8 18.9 —0.2 15.6 
Boys 389 s98 137 125 s69 184 105 29 16.2 2.32* 
Girls 400 oi 147 85.5 18.7 5.6 15.8 
7 Years 271 929 13.6  200* ggg 18.3 2.41* 41 16.0 0.71 
8 Years 273 90.5 148 85.3 19.6 5.1 16.5 
8 Years 273 905 148 2.17" s53 19.6 061 51 165 124 
9 Years 245 877 139 s43 173 34 158 
Negro boys T64 90.2 128 0.07 sis 167 146 s4 15.6 167 
Negro girls 185 90.3 13.6 79.3 15.9 11.1 13.9 
White boys 225 gos 144 152 90.6 187 0415 -ji 154 1.29 
White girls 215 91.7 15.7 90.9 19.2 0.8 15.8 
. 7 3.62" 91 140 3.99%" 
Negroboys,7 50 p19 123 0.26 g28 147 3.62 4 
White boys,7 67 925 122 943 196 -18 154 
Nigoh “6! 909 13.3 0.79 gos 178 3.18" 104 169 4.08** 
White boys,8 78 g9.0 15.0 90.2 179 1.2 16.2 
Negro boys,9 53 gso 122 019 824 170 180 56 154 2.29 
Whiteboys,9 80 37.6 15.0 so 18.1 -0. ! 
Negroirls, 7 71 925 139 07 gia 15.0 478™* 112 140 4.62" 
White girls 7 83 94.2 15.1 94.2 18.3 0.0 160 
; 73,3 185 3.48" ia 15.1 3.55" 
Necrositls, 8 61 g9.7 13.0 106 78. 
Witeri 8 T3 924 16.7 90.1 208 23 143 
0.33 176 B3 32“ 10.6 121 ama" 
Ne irls, 9 53 gs.2 13.3 ; 
Whitegirls, 9 5 873 142 872 17.7 01 170 


* Significant at the .05 level of confidence. 
ae Sienifcant at the ,01 level of confidence. 
a Each child's SB 1Q minus his 


the white children were similar on the two 
tests. Therefore, we accept the null hypothe- 


The average number of points by which 
sis that there is no significant difference be- 


s SB IQs exceeded their 


the Negro caer For the white children, 


e IQs je a was .17 favoring the tween verbal and nonverbal intelligence test 
e average dl G 


CRPM. The ż value for these differences Was scores for low socioeconomic status white chil- 
I. The # v: 


ag: ; onsiders dren, and we fail to accept the null hypothe- 
2226) 18 significant finding whe sis that there is no significant difference be- 


that, for groups of this a Jevel of com tween verbal and nonverbal intelligence test 


is signi the .0 i : 

ie significant when analyzed by age- scores for low socioeconomic status Negro 

ê: j 9 
imilar. The Negro children. 

ee groups; were sim) Phe aie DE mnane a 

children, as a group, s. The IQs of tween Negro boys and girls nor between white 


higher SB IQs than C 
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boys and girls. There were no differences on 


the basis of age groups. This is probably ac-. 


counted for by the decrease in both SB IQs 
and CRPM IQs with increased age. ~ 

The analysis of difference scores revealed 
a sex difference. The girls averaged 5.56 points 
lower in their CRPM IQs, and the boys were 
2.91 points lower. This difference was signifi- 
cant at the .05 level of confidence. Negro girls 
tended to have CRPM IQ scores falling lower 
below their SB IQ scores than did Negro 
boys, and the white girls tended to have lower 
CRPM IQs, while the white boys had differ- 
ences slightly favoring the SB IQs. 


Summary 


In a population of 789 children of low 
socioeconomic status, with an age range of 
seven years to nine years eleven months, no 
evidence was found to Support the hypothesis 
that social bias in the verbal items of the SB 
depressed the SB IQ below the nonverbal, 
nonsocially biased CRPM IQ. 

Mean SB IQs were similar for Negro and 
white children, boys and girls, and for group- 
ings within the three age levels. The CRPM 
discriminated on the basis of color, with the 


Conwell Higgins and Cathryne H. Sivers 


Negro mean scores in all instances lower than 
the white mean scores. 

No significant difference was found for 
white children between their SB IQ, which 
contains many verbal items, and their non- 
verbal CRPM IQ. However, Negro children’s 
CRPM IQ means were significantly lower 
than their SB IQ means. 

It is suggested that the CRPM cannot be 
Considered a test of intelligence or a measure 
of g but is rather a measure of a specific skill. 
The present findings suggest that intelligence 
tests heavily loaded with nonverbal items may 
discriminate against Negro children. 


Received December 10, 1957. 
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Trail Making Test as a Screening Device for 
the Detection of Brain Damage 


Earl C. Brown,’ Albert Casey, Ralph I. Fisch, 
and Charles Neuringer 
VA Center, Wadsworth, Kansas 


The Trail Making Test is a relatively un- 
known instrument, although over the years 
Several investigators have utilized it in mak- 
ing studies. As best as can be determined, the 
Trail Making Test dates back to a prototype 
originally known as the Taylor Number Se- 
ties,? a test which required the subject to 
draw lines connecting a series of numbers 
from 1 to 50 that were scattered randomly 
about a rectangular sheet of paper. In 1938, 
Partington (4) renamed the test “A Test of 
Distributed Attention” and constructed forms 
which were modifications of the above. He 
viewed the test mainly as one that dealt with 
the speed of motor performance. Further use 
of the test, however, led Partington to con- 
clude that a successful performance demanded 
that the subject manifest an integration of 
Previously learned material into a pattern of 
response that involved shifts in organization, 
as well as motor per- 
n and Leiter (4) 
elected adult 
of develop- 
of administra- 


tion and scoring. When the results were scru- 
tinized, the authors con 
Was measuring general me 
demonstrated that the scores on the test were 
in general agreement with the estimated in- 
telligence of the individuals to whom it was 
administered. At that time the test was called 
the Partington Pathways Test. 
A follow-up study (4) in 194 
Selected World War II veterans 


*Currently Area Chief Psychologist, 
edical Office, Columbus, Ohio. 
J. E. Partington. Personal com 


ntal ability. They 


5 on 256 un- 
ranging in 


vA Area 


munication. 1956. 


age between 19 to 36 years, who had also 
taken a Stanford-Binet 1937 Revision, re- 
vealed a .68 correlation between the Path- 
ways and the latter. The test was then in- 
corporated as a performance subtest in the 
Army Individual Test of General Ability (7). 
Again it was rechristened and went under the 
title of the Trail Making Test. As a part of 
the Army battery, it underwent an initial 
validation study conducted on a sample of 
465 soldiers, both white and Negro (6). The 
reliability of the Trail Making was found to 
be .84 for the white group, with the figure 
for the Negroes being essentially the same. 
In final battery form, the test correlated .65 
with the Army General Classification Test. 
This version of Trail Making Test was used 
in the present study. The War Department 
released it from classified status and granted 
the right to reproduce the forms locally. As 
used in the Army, the goal was primarily one 
of quick screening of level of intellectual func- 
tioning. It was felt that the test would pro- 
vide an index that was more accurate than 
one that could be obtained from a group test. 
However, it was also used on clinical popula- 
tions and was deemed to have some predictive 
value in making differentiation between neu- 
rotic and schizophrenic groups (8). For civil- 
lian purposes, the test has also been put to 
use by Leiter and Partington (3) as a sub- 
test in an adult performance intelligence scale. 
Weaver (11) specifically applied the scale at 
the college level and found that the Trail 
Making correlated .62 with Q scores of the 
ACE. 

At the same time, Leiter and Partington 
felt that the test might have some relevance 
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with regard to the evaluation of brain in- 
jury. Watson (10) devised a qualitative 
check list for use in gauging the Pathways’ 
possible value in the evaluation of organics. 
Armitage (1), employing an altered adminis- 
tration procedure, attempted to use the Trail 
Making Test as a part of a battery designed 
specifically for the purpose of evaluating brain 
injury. He felt that the test would measure a 
number of functions such as ability to main- 
tain a double relationship, ability to plan 
foresightfully, ability to make shifts, etc. 
Using the test, he was able to show, to a 
highly significant degree, differences between 
brain damaged Ss and controls composed of 
normals and neurotics—the controls making 
less errors and showing a greater ability to 
recognize and correct them. Scherer and 
Winne,’ however, using the Trail Making 
over a five-year period as a part of a follow-up 
study on lobotomized patients, were not able 
to discover any relationship between Trail 
Making performance and this type of cerebral 
deficit. Humphries,* usin 
ferent administration an 
applied the test in gro 
schizophrenic, and norm 
matched on the basis 


groups from the normal] 
other. 

Finally, Reitan ë used the test on a group 
of highly selected organic patients on which 
brain damage had been established under in- 
tensive and thorough diagnosis, Originally, he 
studied 84 subjects without evidence of brain 
damage as a control group and compared 
them with 200 subjects of known brain dam- 
age. The test was able to discriminate well 
between the groups, with only 16.7% of the 
controls showing as false positives. In a more 
rigorous follow-up study, Reitan (5) admin- 
istered the test individually to 27 Patients 
with brain damage and 27 patients without 
brain damage. He obtained results which sig- 
nificantly differentiated the two groups (p 


< .001). 


3I. W. Scherer and J. F. Winne. Personal com- 
ication. 1956. we 
eae C. Humphries. Personal communication. 1957. 
5 R. M. Reitan. Personal communication. 1956. 
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It seems clear, then, that Reitan’s, Hum- 
phries’, and Armitage’s findings are suggestive 
of the discriminative and fruitful application 
of the test to brain injury. However, the ap- 
proach of Reitan and Armitage involved time- 
consuming definition of brain injury as well 
as a projected use of the test for intensive 
diagnostic purposes. The present study, in- 
stead, emphasized its possibilities as a short, 
simple, and economical screening device for 
the detection of brain damage. The test was 
brought into the clinical setting and admin- 
istered to the patient population as it nor- 
mally presented itself for diagnostic evalua- 
tion, in the hope that such a procedure would 
shed additional light on the test’s value as @ 
practical diagnostic tool. 


Procedure 


The Trail Making Test was routinely ad- 
ministered to all patients referred to the 
Clinical Psychology Section by the Psychiatry 
and Neurology Service, General Medical and 
Surgical Hospital, and Domiciliary, at the VA 
Center, Wadsworth, Kansas. The test was ad- 
ministered by members of the Psychology Sec- 
tion from December, 1954, to October, 1956. 


Materials 


The materials used were two test sheets, 
Part A and Part B of the Trail Making, and 
two pencils with erasers. The examiner kept a 
Pencil in his right hand so that he could point 
to the spots indicated in the directions. He 
did not draw any of the lines for the examinee 
but confined himself to pointing. The test was 
administered in two parts, Part A and Part B. 
Ii Part A was failed, Part B was not admin- 
istered. The time required for completion of 
each part was noted. Part A required Ss to 
draw lines connecting Nos. 1 through 25 in 
their Proper sequence. Part B required follow- 
ing the proper number-letter sequence, 1A- 
2B3C ... 12L. The numbers as well as the 
letters in the case of Part B were enclosed in 
small circles and scattered randomly over the 
test sheets. The Standard administration pro- 

scribed in the Army Individual 


Test Manual (7) was used. 


A 


F 


S 
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Scoring 


For each part passed, the time—in terms of 
seconds—was noted on the space of the test 
blank. If the S failed, a minus or failure sign 
was written and the time not recorded. 

The scores used for this study were of 
three types: (a) time in seconds to complete 
Part A, (b) time in seconds to complete Part 
B, and (c) space score B, indicating the point 
in the number-letter sequence at which failure 
occurred. 


Subjects 

The diagnostic criterion was the final medi- 
cal diagnosis assigned by the individual physi- 
cian in charge of each case. 

The subject population for Part A of the 
test was composed of 39 organic brain-dam- 
aged patients, 14 psychotic patients, 29 other 
NP (neuro-psychiatric) patients with neuroses 
and character and behavior disorders, and 28 
normal patients. For Part B, 16 organic, 7 
Psychotic, 13 other NP, and 15 normal pa- 
tients were available. The difference in num- 
ber of Ss used for each part of the test was 
due to the scoring procedure which yielded a 
time score only if the given part was com- 
pleted. 


Results 

s performance in terms 
A of the Trail Making 
Table 1. In order to 


The analysis of S 
of seconds on Part 
Test is summarized in 


Table 1 


Summary of Analysis of Variance for P: 
of the Trail Making Test 


art A 


Mean 7 j 
Source of variation af square 
iagnosi 275.7 579 <01 
ara 1 4468.9 229 2-05 
10 1 171041 8.78 <.01 
Error o4 1947.8 
In x 
Age TO 1 45639 234 > 05 
Interaction 5 >% 
I Age X Diagnosis 3 1677.7 «8 
nteractio m 
IQ x Damis 3 28720 147 > 
Interaction sü 


3 2873.0 1.47 


Age X IỌ X Diagnosis 


Table 2 


Frequency Distribution of Scores on Part A of the 
Trail Making Test for the Various 
Diagnostic Categories 


Seconds 
(Reciprocals Psy- Other 
X 10,000) Organic chotic NP Normal 
40 4 
41-60 5 
61-80 4 3 a 1 
81-100 2 1 
101-120 4 1 1 1 
121-140 7 5 3 a 
141-160 4 1 1 4 
161-180 2 1 4 4 
181-200 1 3 3 
201-220 2 
221-240 1 3 6 
241-260 1 1 1 
261-280 1 4 $ 
281-300 2 2 2 
301-320 
321-340 1 4 
341-360 1 
361-380 
381-400 1 
401- 2 2 


meet the assumptions underlying the Analysis 
of Variance test, it was necessary, first, to 
apply a reciprocal transformation to the raw 
scores. Thus, the data were analyzed in the 
form of reciprocals of seconds X 10,000. Also, 
inasmuch as the subclass frequencies were un- 
equal, it was necessary to apply special tech- 
niques for computing the sums of squares 
(9, p. 381). 

Significant differences were found to exist 
between the diagnostic categories and between 
the high and low IQ groups, the high IQ group 
taking significantly less time to complete this 
part of the test. 

The means of the diagnostic groups were: 
organic 127.4; psychotic 130.5; other NP 
248.8; normal 217.6. To determine the locus 
of the significant differences obtained between 
the diagnostic groups, the means were treated 
by Duncan’s multiple range test (2). Because 
of unequal Ns, calculations were based on the 
smallest group with an N of 14. According to 
Duncan’s test, the minimum difference be- 
tween means for significance at the 5% level 
is no greater than 35.99. By this criterion, the 
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differences between all means are significant 
with two exceptions, occurring between the 
organic and psychotic groups on the one hand 
and the other NP and normal groups on the 
other. te 

Table 2 represents the frequency distribu- 
tion of the seconds scores on Part A. 

Obviously, the large amount of overlap be- 
tween the groups, especially the organic and 
psychotic groups, rules out the possibility of 
establishing a meaningful cutting score that 
would distinguish clearly between the organic 
and the other diagnostic groups of Ss in the 
present population. Treatment of S’s scores 
in terms of seconds on Part B of the test is 
outlined in Table 3. 

Due to the relatively small Ws present in 
this analysis, it was necessary to pool and 
consider as a unit all nonorganic groups of Ss, 
i.e., the psychotic, other NP, and normal 
groups. As is seen from inspection of Table 3, 
the only comparisons yielding significant dif- 
ferences were between the low and high IQ 
groups and between the two age groups. 
Again, it is clear from the frequency distribu- 
tion of these scores (Table 4) that the estab- 
lishment of a practical cutting score on the 
basis of the present data is not possible. 

Finally, in order to compare more clearly 
the present results with Reitan’s (5) fin dings, 
a frequency distribution Comprised of coded 
scores for Part A plus Part B is given in 
Table 5. Such scores are obtained by applica- 


Table 3 


Summary of Analysis of Variance for Part B 
of the Trail Making Test 


Mean 
Source of variation df square P t 
- : 1 3604 79 sos 
osis 7 
p 1 31960 70 Zol 
10 1 3164.1 69 <.01 
ae 43 453.5 
ar econ 1 94.6 21 >05 
Interaction 
Age X Diagnosis 1 2.3 005 >.05 
Interaction 
10 X Diagnosis 1 67 01 >.05 
Interaction 
"Diagnosis XAgeXTQ 1 11 002 >05 
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Table 4 


Frequency Distribution of Scores on Part B of the 
Trail Making Test for the Various 
Diagnostic Categories 


Seconds 
(Reciprocals 


Psy- Other 
X 10,000) Organic chotic NP Normal 


-20 1 

21-30 1 1 
31-40 2 

41-50 

51-60 1 2 
61-70 4 

71-80 5 2 
81-90 2 

91-100 
101-110 1 1 
111-120 4 i 


= 
Oa mt t a Ua 


121-130 

131-140 1 1 

141-150 1 
151-160 1 

161- 1 3 1 


tion of the Army Test Manual scoring pro= 
cedure (7)—the same procedure that Reitan 
followed in his studies. Ss failing Part B were 
included in this table, in which case a score of 
zero was given for Part B. 

Reitan used a cutting score falling between 
12 and 13. Eighty-three per cent of his con- 
trol group, composed of normal and other NP 
Ss, fell above this score in contrast to only 
17% of the brain-damaged group tested. The 
Present data, however, present quite a differ- 
ent picture. Inspection of Table 6 indicates an 
exorbitant number of false positives asso- 
ciated with the use of this cutting score. It is 
clear from the frequency distributions of 
Part A and Part B scores (Tables 2 and 4), 
Considered Separately or together, that this 
circumstance is due primarily to the inclusion, 
in the present data, of the scores of the psy- 
chotic group which closely parallel the scores 
of the organic group. 

An additional measure, space scores, was in- 
vestigated for the Purpose of testing the hy- 
pothesis that, among the Ss failing Part B, 
the organic Ss would make errors earlier in 


the number~letter sequence than would the 
nonorganic Ss. A Space score simply repre- 
sented the last number Correctly reached be- 


A 
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Table 5 


Frequency Distribution of Coded Scores on Part A 
plus Part B of the Trail Making Test 


Scores* Organic Nonorganic 
20 
19 3 
18 1 
17 1 1 
16 
15 1 1 
14 5 
13 1 1 
12 2 
11 4 
10 2 8 
9 2 10 
8 1 5 
i 1 5 
6 6 9 
5 3 3 
4 5 5 
3 4 
2 4 2 
1 12 2 
N= 39 N=ī1 


^ Reitan's cutting score is between 12 and 13. 


fore an error occurred. Unfortunately, due to 
the short range within which these scores may 
fluctuate, they could neither be normalized 
nor ranked properly for accurate statistical 
evaluation. Nevertheless, inspection of the fre- 
quency distribution of these scores indicated 
that this measure offered little if any advan- 
tage over the previous measures considered. 


Summary and Conclusions 


The present study was undertaken in the 
hope of finding in the Trail Making Test a 
Shorter and more economical method of screen- 
ing for organic brain damage. A number of 
earlier studies, especially those of Reitan, 
Humphries, and Armitage, strongly suggested 
the possibility of such an application for this 
test. The approach, although less rigorous 
than that used in the previously mentioned 
studies, had the advantage of more closely 
aPproximating the conditions under which the 
Problem of practical application of the test 
Could þe subjected to direct inquiry, i.e., con- 
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ditions of clinical practice. In this respect, the 
findings were essentially negative. 

1. Time scores for Part A of the Test were 
found to significantly differentiate between 
the high and low IQ groups and as well be- 
tween the organics and psychotics as one 
grouping and the normals and other NP pa- 
tients as another. 

2. Part B was found to differentiate only 
between the high and low IQ groups and be- 
tween the high and low age groups. 

3. Frequency distributions yielded by both 
measures, considered separately or together 
in the form of coded scores, did not offer the 
possibility of a cutting score that would have 
discriminative diagnostic value with respect 
to the present population. 

4. An additional measure considered, space 
scores, was likewise found to lack discrimina- 
tive value. 

Inasmuch as the diagnostic problem fre- 
quently encountered in clinical practice is one 
of distinguishing between psychosis and brain 
damage, the present findings clearly suggest 
a verdict of “no value” for the Trail Making 
Test in this context. Suggested, further, is 
that any application of the test to a popula- 
tion of the type presently considered must 
take into account factors of age and IQ. 

It is interesting to note that, contrary to 
the experimenters’ expectations, Part A seemed 
more sensitive to diagnostic categories than 
Part B. Part A certainly requires less “dis- 
tributed attention.” It seems rather to more 
closely approximate a simple speed-of-reac- 
tion task. 

Finally, it is suggested that if the merit 
and possible applications of the Trail Making 
Test are to be determined, certain areas of in- 
vestigation should be pursued. Among the 
most outstanding is the possibility for de- 
veloping methods of analyzing errors in a 
more qualitative fashion. Also, relationships 
between age, IQ, method of establishing diag- 
nosis, and Trail Making scores need further 
understanding. 


Received November 22, 1957. 
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Characteristics of Volunteers and Nonvolunteers 
in Psychological Experimentation’ 


R. M. Martin and F. L. Marcuse 
State College of Washington 


A social psychology or generalized conclu- 
sion based on experimental investigations of 
freshmen or sophomores in college is highly 
debatable. Use of volunteers from such fresh- 
Men or sophomore classes is even more de- 
batable for it may represent a selection within 
a selection. In experimental work it is also a 
Wise precaution to know as many character- 
istics as possible of the group being investi- 
gated. 

Studies have been made of the scores of 
volunteers on visuo-motor learning (4), the 
type of person requesting volunteers (5), 
marital adjustment of volunteers (15), as 
well as the nature of the volunteering act it- 
self (2, 9, 10, 11). Maslow and Sakoda (8) 
found volunteers to be higher in a scale of 
self-esteem than nonvolunteers and, as a re- 
sult of their findings, concluded that the 
Kinsey data on sex (6, 7) should allow for 
Volunteer error. Siegman (12), however, using 
a number of personality variables, as well as 
the self-esteem scale used by Maslow, found 
no differences between volunteers and non- 
Volunteers for a Kinsey-type interview. 

The present study proposed to examine the 
Personality characteristics of volunteers and 
nonvolunteers for different experimental situa- 
tions. Reliability of the volunteering act was 
also to be examined. 


Procedure 


Approximately 400 introductory psychology 
Students at the State College of Washington 


“The sco is i ‘sation was made pos- 

i pe of this investigation 

Sible by Grant 3220-110 of the State College of 
ashington. This study was done in partial fulfill- 


me of the requirements for the degree of master 
Science in psychology. 


were used during the different phases of this 
study. Four steps, each separated by approxi- 
mately one week, were involved. They were 
as follows: Step 1 involved the administering 
of a battery of tests. Such tests consisted of 
the Taylor Manifest Anxiety Scale (13), the 
Levinson E (ethnocentrism) Scale (1), and 
the administration of the Bernreuter Person- 
ality Inventory of which four scales were 
used (3). Scores made on the American 
Council on Education Psychological Exami- 
nation (14) were also obtained. Step 2 re- 
quested volunteers. One of the experimenters 
(Martin) met with each of 12 sections and 
presented a volunteer request sheet for one 
of four experimental situations. The situations 
were as follows: One asked for volunteers for 
an experiment dealing with learning, a second 
for personality, a third for attitude to sex, 
and the final one asked for volunteers for 
hypnosis. Three sections were used for each 
specific experimental situation. The written 
request sheet asking for volunteers was made 
as traditional as possible and is reproduced 
here verbatim: 


The Department of Psychology would like to know 
if you can be a volunteer for an experiment dealing 
with [at this point either learning, personality, atti- 
tude to sex, or hypnosis were inserted]. This experi- 
ment will take approximately two hours of your 
time. Volunteering or not volunteering will have no 
effect on your grade in this course. On the sheet be- 
low please sign your name if you can be a volunteer, 
For those of you who indicate you can be volun- 
teers, contact will be made at a later date to inform 
you of the different times available and of the place. 


Step 3 was designed to check the reliability 
of volunteering. The procedure decided on 


was as follows. A week after the original re- 
quest, the same experimenter again met the 
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that reliability 

lunteers. Table 3 shows i 

E E for the different experimental 
situations varied from .67 to .97. Reliability 
ie all four groups considered as a unit was 
86. 


Discussion 


When volunteers and i nonvolunteers are 
each considered as a unit for the four ex- 
perimental situations, they show no differ- 
ence in six of the seven personality variables. 
The one exception to this was the finding that 
volunteers were significantly more intelligent 
(as defined by ACE score) than nonvolun- 
teers. The reason for this may be the fact 
that the more intelligent person is more in- 
quisitive and that volunteering might reflect 
this. The data indicated that female and male 
volunteers for personality have a suggestive 
higher manifest anxiety level than nonvolun- 
teers. It is possible that there is something im- 
plicit in the investigation of personality that 
attracts individuals that are more anxious and 
who feel the need of personal aid or informa- 
tion that such research might seem to offer. In 
the request for volunteers for attitudes on sex, 
no significant differences were found in any 
comparison. This finding has direct bearing on 
an issue that has been of some concern. It was 
pointed out that the publication of the Kin- 
sey reports (6, 7) brought up the question of 
volunteer error which Maslow and Sakoda 
(8) believed would bias its results. Siegman 
(12), on the other hand, found no differences 
between volunteers and nonvolunteers on such 
variables as anxiety, rigidity, defensiveness, 
nor on the Maslow scale of self-esteem, and 
concluded that the problem of volunteer error 
was not present in the Kinsey studies. The 
findings of the present study would tend to 
support the view of Siegman (although the 
reliability of the volunteering response for 
this situation [.67] may cloud the finding to 
some extent) and is not too surprising when 
one considers the myriad of ways employed 
by Kinsey in obtaining volunteers. Volunteers 
for hypnosis as a group were significantly less 
ethnocentric and had a suggestively higher in- 
telligence score than nonvolunteers. This, and 
the very fact that no significant differences 
were found in any comparison between volun- 
teers and nonvolunteers for hypnosis in self- 
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sufficiency, dominance-submission, anxiety, 


| 
| 


and introversion-extroversion, was considered + 


important in that popular belief suggests the 
contrary. . 

While the reliability of the volunteering re- 
sponse in this study was considered satisfac- 
tory, its definition should be noted. It is de- 
fined in terms of verbal indication of willing- 
ness to volunteer, and it may be argued that 
there is a gap between what individuals say 
they will do and their actual behavior. It 
should be realized that the data do not indi- 
cate that those who volunteer for one experi- 
mental situation would volunteer for another 
situation. The data only indicate the reli- 
ability of volunteering for a given situation 
and show that regardless of the experimen- 
tal situation “request” reliability was satisfac- 
tory. 

tt is interesting to note that Wilcox and 
Faw (16), using different tests and describ- 
ing the psychological traits of susceptible and 
nonsusceptible hypnotic Ss (individuals who 
actually participated in an experiment rather 
than volunteers and nonvolunteers), found 
similar results to those reported here. 

Himmelstein (5) has indicated that the ap- 
pearance of the individual requesting volun- 
teers as well as the nature of the request (and 
often in conjunction with it) might be im- 
portant in determining the magnitude of the 
response. This factor in the present study was 
controlled by having the same e 
a presentable, young (24 years) white male 
make all the requests. It would be interesting 
to conjecture what the magnitude of male- 
female response might have been to requests 
for volunteers for an experiment dealing with 
sex or hypnosis if the experimenter had been 
a presentable, young white female! 


xperimenter, 


Summary and Conclusion 


This study concerned the personality char- 
acteristics of volunteers and nonvolunteers for 
different types of Psychological experiments. 
Four specific experimental situations (learn-, 
Ing, personality, attitude to sex, and hypno- 
Sis) requesting volunteers were used. Three 
sections of introductory Psychology were used 
for each specific Tequest situation. The total 
number of Ss used was approximately 400. 
The request sheets asking for volunteers were 
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traditional, Comparisons were made of differ- 
ences between volunteers and nonvolunteers 
for each and for all of the four experimen- 
tal situations on the seven personality vari- 
ables. Reliability of the volunteering act was 
checked. 

Significant differences were found on two 
of the seven personality variables between 
volunteers and nonvolunteers for one of the 
four specific request situations (hypnosis). 
Suggestive differences were also indicated. 
Reliability for the different volunteering situa- 
tions was found to vary from .67 to 97. 

The general conclusion of this investigation 
was that there were personality differences 
between volunteers and nonvolunteers associ- 
ated with different types of volunteering situa- 
tions and that generalizations made from 
biased samples can obviously be misleading. 
The general practice of using volunteers prob- 
ably owes its wide application to matters of 
expediency. However, it does not seem that 
convenience should substitute for sound ex- 
perimental procedure. 
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“Not Alike” Responses in Wechsler's Similarities 
Subtest’ 


Murray Levine 


Devereux Foundation Institute of Research & 


Wiener (2) recently found that the “not 
alike” error in the Similarities subtest in- 


independently measured by a scale of dis- 
trust, had greater intellectual deficit than 
more trusting Ss. One could partially confirm 
his findings if one could show that Ss who 
gave the “not alike” response spontaneously 
had a lower mean IQ than did Ss who did not 
make that particular error. If distrust or sus- 
piciousness pervaded the test performance of 
these Ss, the mean difference in IQ would be 
greater than could be accounted for by the 
lost IQ points due to the error itself, 

The 400 Ss are veterans with a wide va- 
riety of psychiatric diagnoses who had been 
referred for Psychological testing in an out- 
patient setting, 

Two hundred “not alike” Ss were selected 
from our files on the basis of the appearance 
of one or more “not alike” responses to Simi- 
larities test items of the Wechsler-Belleyue 
Form I. The criteria for the “not alike” re- 
sponse were quite stringent. Control Ss were 
selected by taking the next Case in alpha- 
betical order to the man who made the error, 
Unrecorded errors that were made would act 
against the hypothesis, 

There is a highly significant difference in 
IQ in favor of the control Ss, The mean IQ 
for the control group is 109.5 (SD = 15.03), 
while the mean for the not alike group is 


1An extended report of this study may be ob- 
tained without charge from Murray Levine, Ph.D., 
Devereux Foundation Institute for Research and 
Training, Devon, Pennsylvania, or for a fee from 
the American Documentation Institute. Order Docu- 
ment No. 5693, remitting $1.25 for microfilm or 
$1.25 for photocopies. 


Training, Devon, Pennsylvania 


100.8 (SD = 14.39). The mean difference be- 
tween groups yields a t value of 5.92, which 
is significant well beyond the .001 level of 
Confidence. This difference in IQ is consider- 
ably greater than can be accounted for only 
on the basis of the “not alike” error. Loss due 
to “not alike” responses alone amounts to a 


yond the .01 level of confidence. 

The present finding, showing that Ss who 
make the “not alike” error have a lower mean 
IQ than Ss who do not, is in partial confirma- 
tion of Wiener’s previous work with the atti- 
tude of distrust and its relationship to intelli- 
gence. Suggestively, the attitude of distrust 
serves to reduce effectiveness in intelligence 
test performance, 

Because of the substantial differences in 
IQ found in this and a previous study of a 
qualitative error (1), it is our impression that 
further detailed analysis of intelligence test 
e light of current concepts 
will point the way to inte- 
intelligence within a more 
Seneral theory of personality, 

Brief Report. 
Received May 15, 1958, 
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Personal Adjustment, Assumed Similarity to Parents, 
and Inferred Parental-Evaluations of the Self 


Melvin Manis* 
Ann Arbor VA Hospital, Michigan 


Many clinicians have observed that the 
Maladjusted individual tends to feel isolated 
and different from the important figures in his 
environment. One aim of the present study 
Was to provide a quantitative test of this hy- 
Pothesis. More specifically, in view of the 
Importance of parental relationships, it was 
Predicted that the maladjusted individual sees 

Imself as being less like his parents than does 
€ person who is relatively free of emotional 
Problems, 
ated cases cited by Mowrer (14, pp. 531- 
as ) led to the second hypothesis of the 
Udy. Using the semantic differential (15), 
© reported that a male patient at the outset 
therapy rated the concepts “me” and 
Mother” as being more similar than the 
Concepts “me” and “father”; at the termina- 
lon of therapy this pattern was reversed 
ee “me” was rated more similar to “father” 
han to “mother”). Similarly, a female patient 
first saw more similarity between the con- 
Pts “me” and “father” than between the 
Concepts “me” and “mother,” with this pat- 
ern showing a reversal at the termination of 
€rapy. These observations suggest the hy- 
Pothesis that people with emotional disturb- 
‘ces see themselves as being more similar 
> their parent of the opposite sex than to 
“a parent of the same sex, While people who 
€ relatively well-adjusted see themselves as 
cing more like their same-sexed parent. 
th 28 third hypothesis of the study was that 
© maladjusted individual perceives his par- 

S as differing in their evaluations of him. 

ere are two lines of reasoning which lead 


ln: 
a eee study was conducted while the author held 
Ublic Health Service career-teacher grant at the 


nj s 
Wersity of Pittsburgh. 


b 


to this prediction. Both of these formulations 
are related to Brownfain’s finding (2) that 
people with unstable self concepts, i.e., those 
who show a marked discrepancy between 
their positive (optimistic) and negative (pes- 
simistic) self-descriptions, tend to be poorly 
adjusted. From one viewpoint, perceived par- 
ental disagreement may be regarded as a 
source of anxiety which would be particularly 
potent in contributing to the instability of the 
neurotic’s self concept. On the other hand, the 
direction of causality may be reversed. That 
is, since perceived parental evaluations are 
probably colored by autistic factors, the mal- 
adjusted person may project his conflicting 
beliefs about himself onto his parents and 
conclude that their evaluations of him differ 
widely. 
Method 


Two groups of students, one well-adjusted 
and one poorly adjusted, were selected from 
an introductory psychology course; there were 
15 males and 15 females in each group. Per- 
sonal adjustment was defined in terms of 
the S’s performance on the D, Pt, Hs, Hy, L, 
and K scales of the MMPI (9). These scales 
were combined into an over-all measure of ad- 
justment by averaging the Ss’ T scores on the 
four clinical scales (including correction fac- 
tors). In selecting Ss, males and females were 
matched on the basis of this adjustment index. 
The average T score for the adjusted Ss was 
48.3, the average for the maladjusted Ss was 
64.1. Ss who had a raw score above 5 on the L 
scale, or who left out 17 or more items, were 
not included in these groups. In addition, no 
S was included in the adjusted group if he 
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had a T score of 60 or above on any one of 
the clinical scales. F 

The Ss described their “real” selves, their 
“ideal” selves, and each of their parents on a 
series of 24 bipolar rating scales; the Ss also 
described themselves as they thought they 
were seen by each of their parents. The rating 
scales, which were presented in a seven-inter- 
val format, were derived from Cattell’s (3) 
factor analysis of the Allport-Odbert adjec- 
tive trait list (1). Cattell’s analysis resulted 
in 12 relatively independent factors. In the 
present study, the eight factors which ac- 


others. Some 
i €-mature, impatient-patient, and 
intelligent—unintelligent, 


The similarity between the Ss 


, i self-descrip- 
tions and their descriptions of 


their parents 


Results and Discussion 


Personal Adjustment and Assumed Similarity 
to Parents 


The experimental design for the assumed 
similarity data consisted of a 2 X 2 factorial 
design (adjustment x sex) in which two 
scores were available for each S: AS to the 
same-sexed parent and AS to the opposite- 
sexed parent. These data were analyzed in 
accordance with the Type III mixed design 
discussed by Lindquist ? (13, pp. 231-234), 
The results of this analysis are Presented in 
Table 1. 

In this analysis, each of the mean squares 
in the “Between Subjects” Part of the table 
was evaluated against Error (b), while the 
mean squares from the “Within Subjects” por- 


? Inspection of the data Suggested that they did not 
depart markedly from normality. In addition, appli- 
cation of Bartlett's test yielded a nonsignificant re- 
sult, indicating that the variance within groups was 
relatively homogeneous. 
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Table 1 


Analysis of Variance for Assumed Similarity Scores 


Mean , å 
Source df square F 2 
Between Subjects 59 r 
S’s adjustment 1 91.98 11.04 rue 
S's sex 1 79.42 9.53 k 
S’s adjustment X 
S’s sex 1 2019 242 
Error (b) 56 8.33 
Within Subjects 60 
Parent’s sexs 1 1.14 
Parent’s sex X S's 
adjustment 1 4.06 
Parent’s sex X S's 
sex 1 1.54 
Parent’s sex X S’s 
adj. X S’s sex 1 .01 
Error (w) 56 4.26 
Total 119 


s AS to same-sexed vs, opposite-sexed p; 
* Two-tailed test, 


arent, 
tion were evaluated against Error (w). Sig- 
ni were obtained for vari- 


females, 


The results of this analysis do not show 


between assumed 


eraction terms in 
ion of Table 1. 


: if most of the parent- 
highly favorable, i.e., 
ideal selves, well-adjusted 
Ss, having high self-esteem, would of neces- 
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sity show high AS.” Careful examination of 
the data did not, however, support the basic 
assumptions of this view. Instead of being 
consistently favorable, the parent-descriptions 
varied widely in favorability and were, on the 
average, slightly less favorable than the Ss’ 
self-descriptions.* 

The obtained relationship between personal 
adjustment and AS is in general accord with 
Previous findings (4, 10, 11, 12, 17). These 
tesults indicate that the maladjusted person 
typically feels that he is quite different from 
his parents. In addition, since previous re- 
search by Jourard (11) and by Fiedler, War- 
tington, and Blaisdell (7) has shown that 
high AS may reflect liking for the “other 
Person,” these results suggest that the malad- 
Justed person feels less warmly toward his 
Parents than does the well-adjusted person. 

The hypothesis that well-adjusted Ss as- 
Sume more similarity to their parent of the 
same sex than to their parent of the opposite 
Sex was not supported; nor was there any 
evidence that poorly adjusted Ss assume 
Sreater similarity to their opposite-sexed 
Parent. AS to the same-sexed parent was 
about the same as AS to the opposite-sexed 
Parent for both the well-adjusted and the 
Poorly adjusted Ss. It is conceivable that dif- 
ferent results would have been obtained if the 
Items had been specifically selected to repre- 
Sent areas in which quite different behavior 
ls required of men and women. In this study, 

owever, no such attempt was made; instead, 
the items were selected to provide a more 
global coverage of the Ss’ self concepts and 
their perceptions of their parents. 

The fact that women showed less AS to 
their parents than did men was unexpected. 
It may be that this finding is related to differ- 
ences between the typical parent-son and 
Parent-daughter relationship. If, as Fiedler 
(8) hypothesizes, high assumed similarity can 

e interpreted as a sign of interpersonal 
Warmth and closeness, these data suggest that 


_ ® Child (5) has noted a similar artifact possibility 
in reviewing a study by Sopchak QT). i 

*The favorability of each parent-description was 
Quantified by comparing it with the S’s ideal self, 
the D statistic (6, 16) being the measure of simi- 
larity, The favorability of self-descriptions was as- 
Sessed in the same fashion. 
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Table 2 


Analysis of Variance for Perceived Parental Conflict 


Mean 
Source df square F y“ 
Between groups 3 3.42 <.05 
Adjustment 1 6.08 <.05 
Sex í 2.64 
Adjustment X sex 1 153 
Within groups 52 
Total 55 


* Two-tailed test. 


women feel more distant from their parents 
than do men. It should be noted that in spite 
of the obtained sex difference, the relationship 
between AS and personal adjustment held for 
both men and women. 


Personal Adjustment and Perceived Conflict 
in Parental Evaluations of the Self 


To test the hypothesis that the maladjusted 
person perceives his parents as differing in 
their evaluations of him, the discrepancies be- 
tween the inferred parent-evaluations were 
analyzed in a 2 X 2 analysis of variance (ad- 
justment X sex).°'° The results of this analy- 
sis are presented in Table 2. The analysis in- 
dicates that there was a significant difference 
(p < .05) between the adjusted and the mal- 
adjusted Ss in the hypothesized direction—the 
adjusted Ss showed smaller discrepancies be- 
tween their two inferred parent-evaluations 
than did the maladjusted Ss. 

The D scores, which constituted the meas- 
ure of perceived parental conflict, can be 
divided into two components. Part of the D 
is due to differences between the elevations 
of the inferred parent-evaluations. Thus, an S 
may obtain a high D score because he thinks 
that one parent respects him greatly while the 
other holds him in low esteem. Differences 
between the contents of the inferred evalua- 


5 Incomplete data made it necessary to eliminate 
one S from each of the originally selected groups. As 
a result, this analysis included data from 28 adjusted 
and 28 maladjusted Ss; there were 14 men and 14 
women within each adjustment category. 

6 Once again, the data were consistent with the as- 
sumptions underlying the analysis of variance tech- 
nique (see Footnote 2). 
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i stitute the second component. An S 
= Aake that both parents esteem him 
i ill show a large D because of 
equally might still s OT 
his belief that his father would rate him hig 
on Traits a, b, c, and low on Traits d, e, f, 
while his mother would do the opposite. 

The adjusted Ss felt that they were more 
highly esteemed by their parents than did the 
maladjusted Ss. As a result, the adjusted Ss 
might necessarily have shown smaller “eleva- 
tion” differences, since, if the less favorable 
of their inferred parent-evaluations had been 
sufficiently high, the more favorable one 
could not have been much higher. The ad- 
justed group’s smaller D scores might there- 

fore have been due to a restriction on the size 
of their “elevation” differences. 

To rule out this possibility it was necessary 
to demonstrate that “elevation” differences 
were of equal magnitude for the adjusted and 
the maladjusted Ss. A new set of discrepancy 
scores solely reflective of “elevation” differ- 
ences was therefore computed. These scores 
were obtained by (a) calculating the D be- 
tween each parent-evaluation and the S's 
ideal self and (b) taking the absolute differ- 
ence between these Ds. An analysis of vari- 
ance similar to the one reported in Table 2 
was then performed on the resultant measures, 

The results of this analysis indicated that 
the adjusted and the maladjusted Ss did not 
differ in terms of their “elevation” difference 
scores; in fact, the variance due to adjustment 
was smaller than the within groups variance. 
This negative finding means that the results 
of Table 2 were not due to a restriction on 
the range of “elevation” differences which 
could be obtained by the adjusted Ss. 

The negative results of this second analysis 
also mean that the maladjusted person does 

not have any marked feeling that one parent 
regards him more favorably than the other. 
His relatively large D score is apparently due 
primarily to content differences. That is, he 
may feel that while both parents hold him in 
relatively low esteem, they do so for different 
reasons. As a hypothetical example, a malad- 
justed S might believe that one parent thinks 
of him as being secretive and short-tempered, 
while the other does not accept this charac- 
terization, but does regard him as being un- 
dependable and immature. 


Melvin Manis 


While this study has related personal ad- 
justment to perceived conflict between par- 
ental evaluations of the self, the data do not 
enable us to assess the accuracy of the Ss’ 
perceptions. Subsequent research might profit- 
ably attack the question of whether there is 
a real conflict between the parental evalua- 
tions of the maladjusted person. 


Summary 


Two groups of Ss, one well-adjusted and 

one poorly adjusted, were selected from an 
introductory psychology course. The Ss de- 
scribed themselves and each of their parents 
on 24 bipolar rating scales; they also de- 
scribed themselves as they thought they were 
seen by each parent. The D statistic was used 
to quantify (a) the similarity between the Ss’ 
self-descriptions and their descriptions of 
their parents and (b) the similarity between 
each S’s two inferred parent-evaluations. 
The results supported the hypothesis that 
well-adjusted people perceive themselves as 
being more like their parents than do those 
who are poorly adjusted. There was no sup- 
Port, however, for the hypothesis that well- 
adjusted people perceive themselves as being 
more similar to their parent of the same sex 
than to their parent of the opposite sex; nor 
was there any evidence that poorly adjusted 
people see themselves as being more like their 
opposite-sexed parent. An unexpected finding 
was that women perceive themselves as being 
less like their parents than do men. According 
to one viewpoint (8), these results suggest 
that women feel more distant from their 
parents than do men. 

As hypothesized, the data also indicated 
that the maladjusted Ss felt that there was a 
greater disparity between their parents’ evalu- 
ations of them than did the adjusted Ss. 
Further analysis revealed that this was not 
due to any marked feeling among the malad- 
justed Ss that one parent regarded them more 
favorably than did the other. Instead, their 
large Ds were primarily due to content differ- 
ences. For example, a maladjusted S might 
feel that his father perceived him as being 
secretive and short-tempered, while his mother 
did not accept this characterization, but in- 
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stead regarded him as being undependable 
A and immature. 
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A Comparison of the Edwards PPS Variables 
with Some Aspects of the TAT™? 


Tom Dilworth IV* 


Southern Methodist University 


‘The Edwards Personal Preference Schedule 
(PPS) is based on 15 personality needs which 
are also frequently used in the evaluation of 
Thematic Apperception Test (TAT) protocols. 
It would appear, therefore, that the two tests 
seek to elicit comparable information with re- 
gard to needs. The present study investigated 
the correlation between the 15 PPS variables 
and the protocols derived from 10 selected 
pictures of the TAT. Of particular interest 
was assessment of the value of the PPS as a 
reasonable substitute for the TAT in clinical 
situations which may make such replacement 

necessary or desirable. A significantly positive 

correlation could indicate that the PPS (which 
usually requires less time and skill for inter- 
pretation than the TAT) might be used with 
reasonable confidence as an economical and 
valid substitute for the TAT in cases where 
time or skill of the interpreter is a determin- 
ing factor. 

Five qualified clinical psychologists‘ in- 

1An extended report of this study may be ob- 
tained without charge from Tom Dilworth IV, P.O. 
Box 1243, Lexington, Kentucky, or for a fee from 
the American Documentation Institute. Order Docu- 
ment No. 5742, remitting $1.75 for microfilm or 
$2.50 for photocopies. 

2 This report is based on a thesis submitted to the 
graduate school of Southern Methodist University in 
partial fulfillment of the requirements for the M.A. 
degree. The author is indebted to Robert E. Stoltz 
for advice and assistance during the course of the 
g” at the University of Kentucky. 

4 The psychologists were William R. Garretson, 
John H. Gladfelter, Joseph H. Siegel, Aubrey E. 
Wilkinson, and Harold R. Winer. 


dependently evaluated the 10-story TAT pro- 
tocols of 20 college males with respect to the 
relative strengths of the 15 needs reflected 
by the PPS also. The null hypothesis, as fol- 
lows, was confirmed: That there is no sig- 
nificantly positive correlation between the rel- 
ative strengths of the 15 personality needs 
represented intra-individually by the PPS 
and the relative strengths of these same needs 
as indicated intra-individually by the TAT. 
The mean Spearman rank-difference cor- 
relation between the relative strengths of 
TAT protocol needs and the relative strengths 
of PPS needs was .15. This correlation would 


not indicate the feasibility of using the PPS . 


as an economical substitute for the TAT. 
Only 2 of the 20 mean coefficients from which 
the over-all mean of .15 was derived were sig- 
nificantly positive (p = .01). Furthermore, in 
the case of one judge only was there sig- 
nificant agreement between the five highest- 
ranked TAT needs and the five highest- 
ranked PPS needs for each subject ( = .10). 

Reasonably high interjudge agreement on 
TAT need ranks was reflected by a mean 
Kendall coefficient of concordance of .40 (p 
= .02). Additional support for the reliability 
of the TAT judgments was provided by the 
fact that there was homogeneity among the 
judges in their ranking of TAT protocol needs. 


Brief Report. 
Received June 23, 1958, 
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The PALS Tests: A Technique for Children to 
Evaluate Both Parents’ 


Walter C. Williams 


University of Washington School of Medicine 


The evaluation of a parents-child relation- 
ship involves the unique interaction of three 
distinct personalities: father, mother, and 
child. The child’s behavior is commonly 
viewed as the interaction of his personality 
with his environment, which is determined to 
a great extent by the personalities and behav- 
ior of his two parents. For practical purposes, 
his behavior can be regarded as his reaction 
to his parent’s behavior as he sees and inter- 
prets it. 

When the child’s reaction becomes disturb- 
ing to his parents, the school, or society, the 
family is often referred to a child guidance 
clinic for assistance. Here trained personnel 
work as a team, trying to evaluate the child’s 
Personality and behavior through interviews, 
“play sessions,” and tests, and also trying to 
evaluate parental characteristics through in- 
terviews with the mother and father. Often 
only the mother is seen, and it is she who 
Supplies the developmental history, presents 
the complaint, gives her estimate of the situa- 
tion, and attempts to describe her own and 
her husband’s personality traits. 

There are several major problems involved 
in this traditional method. First, what are the 


1 This study was a portion of a doctoral disserta- 
tion completed at the University of Washington, 
1957, supported in part through research funds of 
the Department of Psychiatry, University of Wash- 
ington School of Medicine. Thanks are extended to 
Charles Strother for his valuable assistance. Thanks 
are also due to the staffs of Seattle Public School 
Guidance Department, the Archdiocese of Seattle 
Catholic School System, the Luther Burbank and 

tiscoe Memorial Schools for Boys, the Psychiatric 
Clinic for Children, University of Washington, and 
Psychiatrists Benjamin Taylor and Allan Leider, all 


of whom assisted in the securing of subjects. 


important personal characteristics in the role 
of being a parent that require evaluation? 
Second, how can one avoid weighing the con- 
tribution of the mother so highly as to ignore 
the involvement of the father? Finally, how 
can one bridge the gap between the inter- 
viewer's evaluation of the individual parents 
and the perception and reactions of the child? 

The more prominent dimensions upon which 
parental behavior can be measured are usu- 
ally some variation of the following: Autoc- 
racy—Democracy, Warmth—Coldness, and Pos- 
sessiveness—Detachment, suggested by the 
Fels group (1, 9); Authoritarian, Laissez- 
faire, and Democracy, suggested by Levin 
et al. (12); Dominant, Possessive, and Ignor- 
ing, suggested by Shoben (14). Freud (5) 
emphasized the oedipal pattern of castrating 
father with seductive mother, while Gorer (6) 
and Wolfenstein (17) typify the American 
pattern as weak father with authoritarian 
mother. Attempts have also been made to 
relate specific childhood syndromes to pa- 
rental characteristics. Studies of schizophrenic 
children often point out the frequent occur- 
rence of a dominating, overprotective or re- 
jecting, immature mother, combined with a 
cold and intellectualizing father. Delinquent 
or “acting-out” children are often found to 
come from homes broken by death or divorce, 
where parents who are hostile or indifferent 
exercise discipline which may be classified as 
lax, rigid, or erratic. 

The second problem, i.e., relying too heavily 
on the mother’s interview, stems from the 
practical aspects of having clinic hours dur- 
ing the father’s normal working day, making 
it easier to see the mother only. Much has 
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been said of the “mother-absent” issue, both 
in the case of institutionalized children and 
the working mother, and there is increasing 
interest in the obvious absence of the father 
from the home in our current culture. A great 
many studies indicate that the absence of the 
father ‘‘makes a difference” and it seems justi- 
fied to assume that his presence makes a dif- 
ference also. Many clinic cases involve a gen- 
eral domestic discord, and the ego-defensive 
statements of the mother about her own, and 
her husband’s, involvement in the child’s 
problem cannot be taken at face value. Be- 
cause of the recognized unreliability of such 
“‘self-analysis,” several attempts have been 
made to standardize, in part, the mother’s 
interview (13, 14), and many clinics insist 
that the father be seen also. 

Finally, there is the difficult professional 
problem, after sorting out the relevant pa- 
rental characteristics and situational “facts,” 
of relating this material to the child’s be- 
havioral reactions. Between the environment, 
as seen by the professional interviewer, and 
the behavior, as reported and verified by ob- 
servation in the clinic, stands a perceiving 
organism: the child. The immature, at times 
even neurotic or psychotic, child may place a 
quite different interpretation on his Parents’? 
behavior than would an adult, and it is to 
his interpretation that he is reacting. Parents 
have been found to differ in attitude toward 
children in such variables as ordinal position, 
sex, age levels, to mention just a few. Each 
parent-child relationship appears to be unique 
and has predictive value only in terms of the 
child’s perception of his parents as adult 
sources of need-fulfillment. 

The present study attempts to meet these 
three problems by allowing the child to 
evaluate his parents as he sees and reacts to 
them. It selects for dimensions two parental 
aspects recognized in our culture as impor- 
tant in the role of the parent: a person who 
“should or must be obeyed for some reason,” 

here termed Authority; a person who is ca 
source of warmth and emotional support,” or 
Love. Both mother and father are evaluated 
by the child in these two dimensions, high or 
low in Authority, high or low in Love, on a 
small “battery” of two tests: one a projec- 
tive, one a rating scale. The scoring system 
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is objective, having a consistent frame of 
theoretical reference which permits the two 
test forms to be compared and contrasted. 

The research involves two major steps. 
First, a technique was developed that was 
suitable for use with children, measured the 
hypothesized parental combinations, and had 
satisfactory interrater reliability. Secondly, an 
exploratory study of this new technique was 
made which established that it is a practical 
method of distinguishing between two groups 
of child behavior patterns. 


Dimensions Selected for Measurement 


The Authority and Love dimensions se- 
lected as the basic parental characteristics to 
be measured were suggested by the general 
personality theory of Leary, Coffey, et al. (4, 
7, 8, 10, 11). These researchers use a circu- 
lar continuum of personality variables, using 
these two dimensions as horizontal and verti- 
cal axes, forming a quadrant system of High 
Authority-High Love (HA-HL), Low Au- 
thority-High Love (LA-HL), Low Author- 
ity-Low Love (LA-LL), and High Authority- 
Low Love (HA-LL). Since each dimension 
can be combined with the high or low of the 
other, they are seen as relatively independent. 

In this study, the terms were simply de- 
fined as Authority meaning “one who should 
or must be obeyed for some reason” and Love 
meaning “one who is a source of warmth and 
emotional support.” Test items were selected 
which would combine the high and low of 
each term, judged by a panel of 20 experts 
in the field of parent-child relations, Selection, 
by the child, of a preponderance of statements 
that the parent was one who Was regarded 
as a person who should or must be obeyed, 
placed that parent in a High Authority cate- 
gory, whereas a preponderance of statements 
prejudged as low in this quality placed the 
parent in a Low Authority category. In like 
manner, the child’s selection of High Love or 
Low Love statements placed his parent in 
these respective Categories. Since every test 
item, or statement, contains these prejudged 
qualities of high or low in each of the two 
dimensions, the algebraic sum of the test 
items places the Parent into one of the four 


categories: HA-HL; LA-HL; LA-LL; HA- , 
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LL. Where algebraic summation on each di- 
mension showed cancellation to a near zero 
point on both, a fifth category, the Psycho- 
logically Unknown Parent, was recorded. Since 
each child has two parents, each with five 
possibilities, the scoring system permits 25 
possible parental combinations for each child. 
Each of these five categories provides mean- 
ingful definitions for many of the parental 
characteristics suggested by the literature. 
Authority, exercised with Low Love (rejec- 
tion) resembles “authoritarianism” or “autoc- 
racy,” enforcing obedience through fear and 
punishment. Authority with High Love pro- 
vides safeguards and guidance through re- 
spect and identification, or “democracy.” Low 
Authority encompasses “laissez-faire” in its 
two aspects: with Low Love it is “ignoring”; 
with High Love it is “overindulgent” or “Der- 
missive.” Excessively High Love and High 
Authority may amount to “overprotective” or 
“overpossessive.” The Love axis tends to be 
the leavening agent for the Authority axis, 
Providing a two-dimensional system that re- 
sembles Baldwin’s three-dimensional analysis 
of parent personality (1) which also uses a 
central axis of “Warmth-Coldness,” called 
“High Love-Low Love” in this study. 


Development of the Measuring Instruments 


Several goals were set in the initial plan- 
Ning of the new tests. First, a small “battery” 
was felt preferable, using the two types of 
tests found most useful in assessing interper- 
Sonal relations: the rating scale and the pro- 
jective. The projective was provided with 
Prejudged, forced selection answers, so that 
it could be objectively scored within the same 
theoretical framework as the rating scale. The 
Cartoon form of this test provided the second 
goal: it made the material intrinsically inter- 
esting to children. A third goal, that all words 

e geared to a third grade reading level to 
Permit self-administration, was accomplished 
With the assistance of current second and 
third grade readers and Durrell’s reading lists 
(2). The final goal, acceptance by the three 
disciplines dealing with parent-child relations 
a clinic setting, was accomplished by using 
Seven psychiatrists, seven clinical psycholo- 
_» Sists, and six psychiatric social workers as the 
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judges of the test items.2 These 20 experts 
had test items submitted to them individually, 
were given the definitions of Authority and 
Love stated above, and were asked to rate 
each item as high or low on each dimension 
separately. The method of sequential experi- 
mentation was used with the first six raters, 
three from each discipline, called the Cri- 
terion group. These six had to agree to a cri- 
terion level of 91% to 100%, i.e., 11 of the 
12 ratings, for an item to be accepted and in- 
corporated into the test. Items not meeting 
this level were eliminated and new items re- 
submitted to this panel individually until all 
items met this standard. These final items 
were then submitted, without change, to the 
additional 14 raters. Final total agreement 
with the present scoring system, including the 
Criterion group’s ratings, was 94% with the 
Rating scale form and 98% with the Projec- 
tive form. 

Each form of the test has 32 items for each 
parent, or 64 items in all. Of the 32 items in 
each scale, 8 fall into each of the four pre- 
rated categories of the system: HA-HL; LA- 
HL; LA-LL, and HA-LL. When each axis is 
scored separately, there are 16 possible HA 
statements, 16 possible LA, 16 possible HL, 
and 16 possible LL statements. The highest 
score in any of these four “characteristics” 
would be 16, and the lowest score would be 
a selection of eight high, eight low, cancelling 
algebraically to zero. This algebraic sum for 
each axis, Authority and Love, either positive 
or negative, can be plotted on a circular grid 
to give a visual presentation of the parent’s 
position within one of the four quadrants, or 
close to the axis intersection. This last is, of 
course, the Psychologically Unknown Parent. 
This visual grid system is similar to the one 
used in the Leary-Coffey Interpersonal sys- 
tem (4) and resembles the standard four- 


2 Special thanks are due these extremely busy pro- 
fessional people who sacrificed valuable personal time 
to rate, and often rerate, items many times: psy- 
chiatrists Francis Bobbitt, Lida Brown, Ardis Candy, 
Richard Jarvis, Herbert Ripley, Glenn Strand, Ben- 
jamin Taylor; psychologists Sidney Bijou, Barbara 
Etzel, Ralph Herschstein, Otis Ramsey, Ira Steisel, 
Charles Strother, Theodore Tjossem; and social 
workers Arthur Abrahamson, Virginia Cowling, 
Clarice Hoekstra, Margaret Mykut, Carol Northrop, 
and Nancy Post. 


49() 
quadrant grids showing ordinate and abscissa 
for the plotting of algebraic coordinates. 

The two forms, in combination, are called 
the PALS tests, short for Parental Authority- 
Love Statements. The projective, in 16-page 
booklet form, devotes eight pages to a child 
interacting with his mother, and eight dupli- 
cate pages showing the child interacting with 
his father. Using blank-faced line drawings, 
similar to Rosenzweig’s Picture-Frustration 
Test, the child is shown in a “Need” situa- 
tion, that is, presenting a problem upon which 
the parent must take some action. The eight 
Needs shown with each parent follow Mur- 

ray’s formulation of basic physiological and 
psychological needs: Food, Sleep, Elimination, 
Overt Affection, Independence, Aggression, 
Socialization, and Succorance. These Needs 
are pictured as problem areas in the parent- 
child relationship, showing the typical “com- 
plaints” seen in clinics. Thus the Need Food 
shows a child refusing to eat certain foods, 
the Need Elimination shows a child admitting 
enuresis, the Need Aggression shows sibling 
rivalry. Four “typical” answers for the par- 
ent to make are shown below the cartoon, and 
represent the four major categories. These 
answers represent actual solutions presented 
by parents in a clinic setting when discussing 
the actual situations complained about. The 
child being tested reads instructions present- 
ing these situations as “a boy and his mother 
and father,” and is asked to circle the answer 
he thinks the mother or father would give. 

A Girl’s Booklet shows a girl in these situa- 

tions, and a Boy’s Booklet shows a boy, 

aiding identification. The projective form is 
called PEN PALS (Projected Essential Needs, 
Parental Authority—Love Statements). 

The rating scale is identical for both boys 
and girls, and is called Child’s PALS. One 
side of the page contains 32 items of a gen- 
eral personality nature appropriate to fathers 
and has space for the child to mark each item 
as “Like my Father” or “Not like Father.” 
The opposite side has 32 items appropriate 
to mothers and a similar arrangement to mark 
these statements as Like or Not like Mother. 


3 Inquiries concerning copies of the tests may be 
addressed to the author: Walter C. Williams, Uni- 
versity of Washington School of Medicine, Seattle 5, 
Washington. 
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The choice is again forced, and the items are 
prejudged into one of the four major cate- 
gories. Note, however, that the child is here 
told that he is rating his own parent, and his 
evaluative statements are much more con- 
scious than when marking the projective. For 
this reason the projective was always given 
first in the exploratory study. 


Exploratory Study 


Subjects and Administration 


To determine if the PALS tests could dis- 
tinguish between two populations, thus indi- 
cating practical diagnostic value, two well- 
defined samples were selected. The known 
difference was a matter of public record in 
some social agency: one group had been 
classed by society as “acting-out” in a hos- 
tile and aggressive manner, whereas the other 
group had not been referred for this behavior 
but were classed by their teachers as “nor- 
mal” and well-behaved, channeling their ag- 
gressions into socially acceptable competi- 
tion. A maximum control was established on 
all other variables: the two groups were 
matched as to age, sex, race, type of school 
attended, socioeconomic status of family, and 
presence of two natural parents in the home. 
Boys, aged 94 to 134, white, of normal in- 
telligence, living at home with both natural 
parents, were also matched as to type of oc- 
cupation of fathers. Fifty children were used 
in each population, or one hundred in all. 
The hypotheses dealt with predictions that 
the two groups would use the PALS tests to 
classify their parents in a different manner: 
the Acting-out group as “socially undesirable” 
people, the Normal group as “socially desir- 
able” people. 

The Acting-out children were tested first, 
then matched from the wider selection of 
Normal children, 14% from private schools, 
86% from public schools, in accordance with 
the proportions in the Seattle school systems. 
Acting-out” was defined as having social 
agency or private practice referral for such 
socially undesirable behavior as overt aggres- 
Sion, stealing, lying, destructiveness, running 
away, or other overt revolt against adult au- 
thority. Twenty-three, mostly from the lower- 
income group, had been committed by court 
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action to special schools, 23 were patients at 
the University’s Psychiatric Clinic for Chil- 
dren, and represented lower to upper middle 
class. Four were upper class, patients of psy- 
chiatrists in private practice. Normals were 
matched to this group using Type and Level 
of parental occupation, a modification of the 
Index of Status Characteristics published by 
Warner, Meeker, and Eels (15). The mean 
value indicated that the matched populations 
clustered around the skilled and semiskilled 
manual occupations. The median age for both 
groups was 11.54, with half above and half 
below this value. All were in the upper four 
elementary school years. The Normals were 
individually selected with the cooperation of 
teachers to match the acting-out group ex- 
cept for the tested variable. 

All tests were administered by the experi- 
menter who was male, white, age 42. Tests 
were administered individually in a private 
room. Standard instructions for seli-adminis- 
tration were given, and reading ability veri- 
fied by having the child read the instructions 
aloud. The projective, PEN PALS, was given 
first, followed by the rating scale, Child’s 
PALS. Time ranged from 20 to 30 minutes 
for both tests, including checking to see that 
all items had been marked. 


Scoring and Evaluation of Test Results 


The scoring system, representing an alge- 
braic summation on two axes, places the in- 
dividual parent into one of the five categories. 
Since the variable being studied in the two 
groups of children dealt with the social desir- 
ability of their behavior, a similar na 
was logical in relating the category © the 
parent to the behavior of the child. The ar 
Categories indicating High Love were cng a 
as SD, or Socially Desirable, whereas i 
three categories indicating rejection w 
classed as SU, or Socially Undesirable. j e 
Authority axis was relegated to a secon ary 
Position, since High Authority with Toye A 
favorable social connotations of porion e 
child with understanding controls, but pý 
Authority with Love, oF rane à 
also favored in our culture. Taking the p ; 
ents as a “team,” both should be high z ae 
for an SD combination. Thus, of the Pe 
Sible parental combinations, only 4 are 59, 
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while 21 are SU because one or both parents 
are classed as rejecting. 


Results 


Twenty-three of the 25 possible parental 
combinations appeared in the 200 protocols 
of the combined groups. The two missing pat- 
terns showed the mother low on both axes, 
with the father High Authority-Low Love, 
and Low Authority-High Love. Two com- 
binations accounted for 60% of all ratings. 
Combination I, showing both parents high in 
both axes, accounted for 379% of all ratings. 
Combination II showed the father high on 
both axes, with the mother high in Love, low 
in Authority, and represented 23% of the 
ratings. All other patterns were below 5% of 
the total. 

Comparing the two populations, however, 
presented quite a different picture. Combina- 
tion I accounted for 55% of all Normals’ rat- 
ings but only 19% of the Acting-out group’s 
ratings, and Combination II was selected by 
279 of the Normals and 18% of the Acting- 
out children. In summary, these two, showing 
father high in both Authority and Love, and 
mother high in Love but not as strong in Au- 
thority, accounted for 82% of all the Normal 
children’s ratings, but only 37% of the Act- 
ing-out children’s ratings. The remaining 63% 
of this last group’s ratings tended to cluster 
around those designating the father as “Au- 
thoritarian,” i.e. high in Authority, low in 
Love, accounting for another 48%, in contrast 
to only 14% of the Normals’ ratings of father 
in this category. The Acting-out children also 
tended to class their mothers as Psychologi- 
cally Unknown, that is, either inconsistent or 
inadequate in both Authority and Love. Thus 
38% of their ratings of mother fell in this 
category, as compared to only 4% of the 
Normals’ ratings. 

Grouping the parental combination ratings 
for each test form, for each population, in 
terms of the previously established definition 
of Social Desirability (high in Love for both 
parents), Table 1 presents the observed data. 
Evaluating this data against an “expected” or 
statistically derived cell frequency of 8 SD, 
42 SU, the chi square values were highly sig- 
nificant (beyond the 001 level) for both Nor- 
mal and Acting-out children using the rating 
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Table 1 


Number of Children in the Normal and Acting-Out 

Populations Rating Their Parental Combinations as 

Socially Desirable or Socially Undesirable, Contrasting 

the Use of the Rating Scale, Child’s PALS, to the 
Projective Form, PEN PALS 


Child’s PALS PEN PALS 

SD SU N SD SU N 
Normals 49 1 50 38 12 50 
Acting-out 36 14 50 11 39 50 
Totals 8 15 100 49 51 100 


sheet, Child’s PALS, and for the Normals 
using the projective PEN PALS. The data 
for the Acting-out children, using the pro- 
jective form, was not significantly different 
from a chance distribution. 

It was now possible to compare the popu- 
lations with each other, analyzing their per- 
formances on each test form, evaluating the 
major hypothesis that each form had the 
ability to distinguish the two populations. On 
the rating scale, Child’s PALS, the compari- 
son of the two groups, yielded a chi square 
value of 11.29, significant beyond the .001 
level at 1 df. On the projective form PEN 
PALS, the chi square value was even higher, 
27.05, beyond the .001 level at 1 df. The 
hypothesis was supported, therefore, that on 
each form of the test the Mijormalf rated 
their parents as socially desirable combina- 


tions more frequently than did th Acting- 
out children. j 
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It was also hypothesized that the Normal 
children would be more consistent in their 
evaluation of their individual parent, whereas 
the Acting-out children would tend to change 
more often, that is, rate a parent one way on 
the projective, another way on the rating 
scale. To test this the two forms were taken 
as a unit: either they were both used to rate 
the parents as SD, or both SU, or SD on one 
form, SU on the other. Table 2 shows the 
data recorded in this fashion, a three-way di- 
vision for the father and another three-way 
division for the mother. The term “Change 
is used here to mean “absolute change,” since 
the direction, that is, which test was SU and 
which SD, is ignored. si 

Each of the three columns, or “possibili- 
ties,” can be evaluated by comparing it to 
the sum of the other two. Using Fisher’s Ex- 
act Method (3), a probability of less than 
-001 was found for the difference between the 
two groups rating their parents as SD. The 
hypothesis is therefore supported that Nor- 
mal children will tend to rate both mother 
and father as Socially Desirable consistently 
on both forms of the test more often than will 
the Acting-out children. 

Using the same method, that is, combining 
the SD and Change to compare with the SU 
column, it was found that the hypothesis was 


/ supported that the Acting-out children tended 


to rate their parents consistently SU more 
often than did the Normals. Fisher’s method 
gave a less significant value for this type of 
“consistency”: .003 for the difference in rat- 
ing fathers and .013 for the difference in rat- 


Table 2 


Number of Children Rating Individual Parents as Socially Desirable on Both For 
as Socially Undesirable on Both Forms, 


ms of the PALS Tests, 
Form, Socially Undesirak 


or as Socially Desirable on One 
ble on the Other 


Fathers Mothers 
ee 
Both Both Change Both 
SD SU SD-SU WV SD. So a N 
Normals 39 0 11 50 46 
Acting-out 14 8 28 50 21 z 5 a 
Totals 53 8 39 100 


100 
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ing mothers. Both are accepted as statistically 
significant at these levels, however. 
Combining the two “Both” columns, we 
compare “Consistency” vs. “Change.” As was 
predicted, the Normals were more consistent, 
whereas the Acting-out group more often 
tended to change the parent from SD on one 
test, then shift to SU on the other. Chi square 
for both the mother and father data was sig- 
nificant at the .001 level. All the changes 
shown for the father data were in the direction 
of SD on the Child’s PALS to SU on the PEN 
PALS, therefore no additional analysis was 
necessary. The “Change” shown for the 
mother data involved a reversal in four of 
the ratings: three for the Acting-out and one 
for the Normals. Additional tests were run to 
insure that these reversals did not affect the 
statistical significance. They were deducted 
from the “Change” value, and the difference 
was still found to be significant at the .001 
level. The reversals were evaluated by Fisher's 
method, and a probability of .25 was found, 
ie., not significant. The only significant dif- 
ference appears to be the more usual pattern 
of Change: rating the parent SD on the rat- 


_ ing scale and SU on the projective. 


As with the other data, chi square tests 
were run routinely on the two “Consistency” 
measures and the “Change” measure to see if 
they were statistically different from a chance 
distribution. Expectancy 
for Both SU is 18, for Change is 24. All 
four populations were evaluated: fathers and 
mothers for each group. The tests for all four 
sets of data showed the SD ratings more fre- 
quent than chance expectations at better than 
the .05 level, the SU ratings less frequent than 
chance at the .01 level. The data for both 
parents, Normal group, for Change was sig- 
nificantly less than chance at the .01 level. 
The “Change” value for the Acting-out group 
for both parents was not significantly differ- 
ent from a chance distribution. 


Discussion 


The Testing Instruments 7 

Although it is difficult to evaluate the clini- 
cal usefulness of a testing instrument until it 
has been used with many populations over an 
extended period of time, there are several 


for Both SD is 8, 
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praciical aspects which favor the type of tech- 
que used in this study. Administration of 
both forms takes from 15 to 30 minutes, and 
scoring takes less than 10 minutes. The stand- 
ardized scoring system, based on expert opin- 
ion, not only eliminated to a great extent the 
test-maker’s personal bias in item selection 
but will continue to function in this way to 
eliminate the administrators’ bias in test in- 
terpretation. Item selection through sequen- 
tial experimentation with representatives of 
psychiatry, clinical psychology, and social 
work tended to screen out interdisciplinary 
differences and should increase communica- 
tion and acceptance of the test results. 

Of the two forms, the projective (PEN 
PALS) had greater discriminatory power, was 
less subject to social-desirability factors, and 
was obviously more interesting to both raters 
and children. Although there is a temptation 
to use this form without the Child’s PALS, 
several factors indicate that the saving in 
time would not compensate for the loss of 
information. The more direct rating scale 
most closely resembles the type of answers 
given by a child in a series of psychiatric in- 
terviews when asked to describe his parents. 
Unlike the forced choice of the PEN PALS, 
the child is free to discard an item as “not 
like” his parent, and those he selects carry 
extra weight because of this factor. By itself 
the Child’s PALS shows discriminatory power, 
and appears to tap the “more conscious” rec- 
ognition of ental characteristics, in con- 
trast to the “less conscious” areas expressed 
in the p ojective form. Both forms, used as a 
small “battery,” give a more complete picture 
of the child’s overt and covert feeling about 
his parents as people as well as parents, and 
within a consistent frame of reference for 
purposes of comparison. Finally, a “Consist- 
ency” or “Change” evaluation, indicated as 
a significant factor by analysis, depends on 
the use of both forms. 


The Exploratory Study 

The use of 23 of the 25 parental combina- 
tions possible in this scoring system would in- 
dicate that classification systems limiting pa- 
rental combinations to a few cultural stereo- 
types may miss important relationships. The 
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two favored combinations, on inspection, ap- 
pear to be the most culturally acceptable, 
however, and present a measure of “conform- 
ance.” The fact that 82% of the ratings by 
Normals, in contrast to only 37% of the Act- 
ing-out group’s ratings, conformed to the cul- 
ural ideals suggests that the PALS tests are 
sampling an important aspect of the difficul- 
ties experienced by Acting-out children. The 
present study makes no claims as to where 
the “nonconformance” is located. The present 
level of interpretation places it merely in the 
behavior of the child on this test, but this 
does not preclude the strong possibiliy that 
additional investigation will move the level of 
interpretation up to the behavior of the par- 
ent. It may well be that this Acting-out child 
is using this test as just another means of 
acting-out against his parent, making it a 
sensitive behavioral sample. It may also be 
that the parent is nonconforming, at various 
levels of unconscious to conscious or covert to 
overt behavior, and that this is perceived and 
reacted to by the child in imitation and iden- 
tification. Additional studies are now in prog- 
ress to determine what levels of interpretation 
seem justified by the data. 
Several points require clarification. The so- 
cioeconomic status represented the less con- 
trolled data of the Acting-out group and be- 
came a selective factor in the Normals, who 
were used as matched controls. It cannot be 
interpreted to mean that “in general, Nor- 
mals and Acting-out children come from the 
same socioeconomic group.” The requirement 
that all children come from unbroken homes 
was also a selective factor for both groups. 
It became apparent, however, that it was 
much more selective for the Acting-out chil- 
dren, since it was so much more difficult to 
find children of this group who did not come 
from broken homes. The Acting-out children 
selected, therefore, were probably “more nor- 
mal” than an unselected group would be. A 
third element requires consideration: the or- 
der of test presentation. The projective form 
was always given first, and it is unknown how 
this affected the difference found in the two 
forms. 
All hypotheses were confirmed, regarding 
the difference in performance of the two popu- 
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lations studied, at a high level of statistical 
confidence. Both test forms, taken as indi- 
vidual tests and in combination to form 4 
“battery,” were found to distinguish the popu- 
lations. It is obvious that the principal con- 
tribution of this study was the development 
of the technique, not a thorough analysis of 
the differences between normal and acting-out 
children, nor a complete analysis of the vari- 
ous uses of the test forms. The limited ex- 
ploratory study was used to show discrimi- 
natory power and support plans for more in- 
tensive research with additional populations. 
Such plans include studies of girls, of differ- 
ent age groups, cross-validation with other 
techniques using the child-centered view- 
point, having parents evaluate themselves and 
spouse, having expert interviewers fill out the 
test for the three individuals involved. 


Summary 

A new technique, combining a rating scale 
and projective with consistent theoretical 
framework and objective scoring system, has 
been developed as a research and applied 
clinical tool in the area of parent-child rela- 
tionships. Geared to third-grade reading level, 
it permits a child to evaluate his unique in- 
terpersonal relationship with each parent as 
he sees it. He rates each parent on two 
continua: Authority (one who should or must 
be obeyed for some reason) and Love (a 
source of warmth and emotional support). 
The “high” and “low” of each used as axes 
form a quadrant scoring system of four ma- 
jor categories, plus a fifth, the “Psychologi- 
cally Unknown” parent, defined in terms of 
algebraic cancellation. 
_ The rating scale, Child’s Parental Author- 
ity-Love Statements (Child’s PALS) and the 
projective, Projected Essential Needs, Paren- 
tal Authority-Love Statements (PEN PALS) 
can be visually plotted to compare and con- 
trast the conscious and less conscious evalua- 
tion of each parent. Test items were derived 
by the method of sequential experimentation, 
using 20 expert raters from the fields of psy- 
chiatry, clinical Psychology, and psychiatric 
social work, Interdisciplinary agreement was 


947% on the Child’s PALS and 98% on the 
PEN PALS. 
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A limited exploratory study was made to 
determine if the PALS tests could distinguish 
between two populations of known character- 
istics in a given area. The area was a record 
of delinquent behavior, i.e., referral to some 
legal or social agency for antisocial or socially 
unacceptable behavior. Boys with such a rec- 
ord were termed Acting-out, boys without 
such record but who were normally competi- 
tive, were termed Normal. Both groups, 50 in 
each, had been living with both natural par- 
ents and were matched for age, race, socio- 
economic status, and type of school attended. 
Self-administered individual tests were given, 
the PEN PALS first. 

Results were evaluated at a child-behavior 
level: samples of a known tendency of one 
group to act-out in a socially undesirable 
manner and the other group to conform in a 
socially desirable way. Parental combinations 
were thus divided into two major groups: 
those showing both parents high in Love, 
hence Socially Desirable; those showing one 
or both parents low in Love (rejecting) or 
psychologically unknown, hence Socially Un- 
desirable. 

All predictions were supported at a high 
level of statistical significance. Twenty-three 
of the possible 25 parental combinations were 
used, with Normals showing a much higher 
percentage of the two most acceptable paren- 
tal patterns. These showed the father as high 
in both Authority and Love, with one pattern 
showing the mother also high in both, the 
other showing the mother high in Love only. 
Both forms, individually and in combination, 
showed Normals more likely to rate their pa- 
rental combinations and their individual par- 
ents as Socially Desirable and Acting-out chil- 
dren more likely to rate their parents as So- 
cially Undesirable. The Acting-out group also 
tended to change an individual parent’s clas- 
sification from undesirable on one test form 
(PEN PALS) to desirable on the other form 
(Child’s PALS) more often than did the 
Normals. 

It is concluded that since the PALS tests 
have been established as having the ability to 
discriminate between these two populations of 
boys they may also be useful in the research 


and diagnosis of other behavior syndromes 
and other populations. 
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Cultural Symbolism: The Age Variable 
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Levy (1) reported that his experiment with 
62 normal school children did not support the 
Freudian hypothesis of sexual symbolism. 
Starer (2) subsequently reported a similar 
experiment with male and female psychotic Ss 
and student nurses, which gave strong sup- 
port to this same hypothesis. The present 
study attempts to discover the source of the 
discrepancy in the results of these two in- 
vestigations. 

The first part of this study consisted of a 
replication of Starer’s (2) experiment with a 
modification in the number of Ss, viz., 20 psy- 
chotic adults, 10 male and 10 female, and 25 
university students, 15 male and 10 female. 

As in Starer’s original study, Ss were asked 
to match 10 names (five male, five female) 
with 10 figures (five “male” symbols and five 
“female” symbols). 

The number of correct matches for the psy- 
chotic and university populations were sig- 
nificant (chi squares 35.47 and 52.19 respec- 
tively, p < .001). 

These results confirm Starer’s findings. 
They do not point directly to the cause of the 
Starer-Levy discrepancy, but do provide addi- 
tional support for the hypothesis of cultural 
symbolism. 

In the search for the factors which might 
have produced the discrepancy between the 
Levy and Starer results, several possible vari- 
ables suggested themselves: (a) Starer used 
individual testing, whereas Levy used a group- 
testing technique; (b) each author used stim- 
ulus figures of his own design; and (c) the 


1 The authors wish to thank E. Starer and L, H. 
Levy who kindly provided copies of the figures and 
names used in their respective studies. 

2An extended report of this study may be ob- 
tained without charge from R. G. Stennett, Chief 
Psychologist, Ontario Hospital, St. Thomas, Ontario, 
Canada, or for a fee from the American Documenta- 
tion Institute. Order No. 5741, remitting $1.25 for 
microfilm or $1.25 for photocopies. 


subject populations differed with respect to 
composition (normal vs. psychotic and nor- 
mal) and age (children vs. adults). However, 
since Starer’s results with student nurses were 
positive and since the results of our replica- 
tion of Starer’s work with university students 
were positive, the normal vs. psychotic dif- 
ference did not seem important. We also rea- 
soned that the group vs. individual testing 
difference was relatively unimportant. It 
seemed, therefore, that the discrepant results 
were due to either differences in the stimulus 
figures or differences in the age of the popula- 
tions studied. The purpose of the second part 


of the study was to investigate the figure 
variable. 


Ss in this part (37 student nurses, with a 
mean age of 19) were group tested with both 
the Levy and Starer figures, with instructions 
to match the names to the figures. 

The Ss matched the Levy and Starer figures 
with male and female names better than 
chance. The chi squares for the Levy and 
Starer figures were 13.72 (p < .01) and 38.90 
(p < .001) respectively. 

Since a group-testing procedure was used 
with both Levy and Starer figures and since 
Ss matched names to both sets in a statisti- 
cally significant manner, differences in the 
stimulus figures cannot account for the dis- 
crepancy under investigation. The variable of 
age, therefore, assumes crucial importance. 
This suggests that a careful developmental 
study of cultural symbolism would reveal data 
of theoretical importance. 

Brief Report. 
Received June 13, 1958. 
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} New Test 


‘Cattell, Raymond B., Beloff, Halla, & Coan, Richard 
W. IPAT High School Personality Questionnaire 
(HSP.Q.)- Ages 12-17 years. 2 forms. Untimed, 
(40) min. Test booklet Form A or Form B ($4.00 
per 25 or $3.50 per 2 or more packages) ; answer 
sheet ($1.90 per 50 or $14.90 per 500) ; hand scor- 
ing key (60¢); handbook, pp. 58 ($2.20), and 
tabular supplement of norms, pp. 10 (80¢) ; sam- 
ple set $3.10). Champaign, Ill.: Institute for Per- 
sonality and Ability Testing, 1958. 

The H.S.P.Q. is a thorough revision of the earlier 
IPAT Junior Personality Quis, and is a close rela- 
‘tive of the Sixteen Personality Factor Questionnaire. 
Each form of the H.S.P.Q. contains 140 forced-choice 
items, 10 items for each of 14 factors. No item is 
scored for more than one factor. The 14 factors are 
drawn from the well-known factor-analytic studies 


of the senior author, and include Schizothymia vs. 
Neuroticism VS. Ego- 


Cyclothymia, Intelligence, Eg 
«strength, Phlegmatic Temperament VS. Excitability, 
an unusual asset 


etc. The provision of two forms is 
among personality questionnaires. The handbook rec- 
ommends that one form be used for survey testing 
with the second form for retesting, oF that both 
forms be used for more intensive individual studies 
ase reliability. 

bring to sharp focus an 
ized by the test’s authors—broad cover- 
per factor versus more reliable 
r of variables. Judged 
the reliabilities of 
ores are low. Retest with one 
j ee s factor reliabilities of 
form atter FoS vi «an of .58. The correla- 
ions of the factor scores obtained from the two 
Tou are even lower, from .26 to 51, with a median 
of 37. The Jatter data ce 

jvalence of t 

me aa the factors have been represented by the 
- jtems. On the other hand, the construct validities, in 
terms of the multiple correlations of the items with 
the pure factors as obtained from the original factor 
analyses, are reported as fairly high, ranging from 


58 to .78 for each form, and from .73 to 88 for the 


coverage 0 


PSYCHOWOGICAL 
TEST \RIE [EWS 


two forms used together. Intercorrelations are gen- 
erally low, with only 5 of 91 7’s exceeding .30. 

Tentative norms in stens (10-point standard 
scores) and deciles are based on 1,189 American 
boys and girls, ranging in age from 11 to 20, with a 
median of 14.5 years. Their geographic distribution 
is unspecified, but they seem to come mainly from 
a few midwestern cities. Tables are given for boys 
and for girls separately, and for the sexes combined. 
Age corrections are supplied for the two factor 
scores which vary significantly with age. 

The authors urge that no factor score be inter- 
preted separately. Two methods for global use are 
described, by matching profiles and by regression 
equations. Unfortunately, these useful methods are 
represented only by jllustrative examples. There is 
no compendium of criterion profiles or of regression 
equations against external criteria. The two illustra- 
tions of the regression method—for the prediction of 
leadership and of school achievement—are so inade- 
quately described that the reader is unable to evalu- 
ate the merit of the research on which they are 
based. In contrast to the implied rigor of the regres- 
sion equation method, the handbook contains sev- 
eral pages of “clinical” suggestions, supported by no 
explicit data. 

In summary, the reviewer sees the H.S.P.Q. as a 
potentially valuable instrument when further re- 
search has supplied sound actuarial data. But it is 
subject to serious misuse if the unreliable single fac- 
tor scores are given stereotyped jnterpretations, sup- 
ported only by the interpreter’s intuitive hunches 
about the meanings of the factors—L. F. S. 


Erratum 


The review of the Minnesota Counseling Inventory 
in the June issue of this Journal (p. 241) contained 
the misstatement that “there is no indication of item 
analysis against a criterion.” Although no detailed 
data are given concerning the item analyses, the 
Manual (p. 24) states that all items were evaluated 
against the external criteria of nominations and rat- 
ings, and against the internal criterion of total score 
on the appropriate scale. The Editor is grateful to 
Dr. Wilbur L. Layton for calling his attention to this 
oversight —L. F. S. 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or.lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 


-An author who wishes to submit a Brief 
Report: 


1. Sends the Brief Re 
page and prepared 
given below, 

2. Also sends to the Editor a full r 
search study, in sufficient detail to 


port, limited to one printed 
according to the specifications 


eport of the re- 


4. Agrees not to submit the f 


ull report to another 
journal of general circulation, 


Specifications 


Brief Report. The Brief Report should give 
a clear, condensed summary of the procedure 
of the study and as full an account of the re- 
sults as space permits, 

To insure that the Brief Report will be no 
longer than one printed Page, its typescript, 
including all matter except the title and the 
author’s lines, must not exceed 75 lines av- 


eraging 42 characters and spaces in length. 
Set the typewriter margins for short lines of 
42 characters, which are 3.5 inches long in 
elite typing, and 4.2 inches long in pica. 

The manuscript of the Brief Report must 
be double spaced throughout. Except for its 
short lines, it follows the standard style (1). 
Headings, tables, and references are avoided 
or, if essential, must be counted in the 75 
lines. Each Brief Report must be accom- 
panied by a footnote in the style below, 
which is typed on a Separate sheet and not 
counted in the 75-line quota: 1 


7 An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. (giving the author’s full name 
and address), or for a fee from the American Docu- 
mentation Institute. Order Document No, ——, re- 


mitting $— for microfilm or $ for photo- 
copies. 


in the style speci- 
fied by the Publication Manual (1). à 
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